How can you uncache data in Spark

SAS
0
How to Unpersist DataFrames and RDDs in Apache Spark
Answer Thumbnail

You can uncache a DataFrame or RDD by using the .unpersist() method. This frees up memory or other storage resources.


  fabricofdata_df.unpersist()
  fabricofdata_RDD.unpersist()

If you want to unpersist all cached data:

  spark.catalog.clearCache()


Tags:

Post a Comment

0Comments

Post a Comment (0)

#buttons=(Ok, Go it!) #days=(20)

Our website uses cookies to enhance your experience. Check Now
Ok, Go it!