Hello richardthomas66@hotmail.com,
Have you tried spark.catalog.clearCache()
method? This will clear the cached data in Spark. This method removes all cached data from memory and disk.
You can also see the below threads:
I hope this helps.
This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
Ive tried many articles and links without success.
Has anyone managed to successfully clear the cache on their Databricks cluster? This causes many issues as my memory is near its peak, meaning my notebooks often crashes. Any help or advised would be much appreciated.
Hello richardthomas66@hotmail.com,
Have you tried spark.catalog.clearCache()
method? This will clear the cached data in Spark. This method removes all cached data from memory and disk.
You can also see the below threads:
I hope this helps.