Home PySpark-Q&A When would you choose MEMORY_AND_DISK over MEMORY_ONLY? When would you choose MEMORY_AND_DISK over MEMORY_ONLY? SAS April 16, 2025 0 When the dataset is too large to fit entirely in memory. MEMORY_AND_DISK prevents re-computation by saving the overflow to disk. Tags: PySpark-Q&A Facebook Twitter Whatsapp Newer Older