memory

Type Members

1. abstract class MemoryEventListener extends AnyRef

   

2. class MemoryManagerStatsWrapper extends MemoryManagerStatsOps

   

   A wrapper class for Split mode.

   A wrapper class for Split mode. In case of split mode UMM stats update will be a no-op

3. class SnappyStorageEvictor extends Logging

   

4. class SnappyUnifiedMemoryManager extends UnifiedMemoryManager with StoreUnifiedManager with StoreCallback

   

   When there is request for execution or storage memory, critical up and eviction up events are checked.

   When there is request for execution or storage memory, critical up and eviction up events are checked. If they are set, try to free the memory cached by Spark rdds by calling memoryStore.evictBlocksToFreeSpace. If enough memory cannot be freed, return the call and let Spark take a corrective action. In such cases Spark either fails the task or move the current RDDs data to disk. If the critical and eviction events are not set, it asks the UnifiedMemoryManager to allocate the space.