|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
@InterfaceAudience.Private @InterfaceStability.Unstable public interface MergeManager<K,V>
An interface for a reduce side merge that works with the default Shuffle implementation.
Method Summary | |
---|---|
RawKeyValueIterator |
close()
Called at the end of shuffle. |
MapOutput<K,V> |
reserve(TaskAttemptID mapId,
long requestedSize,
int fetcher)
To reserve resources for data to be shuffled. |
void |
waitForResource()
To wait until merge has some freed resources available so that it can accept shuffled data. |
Method Detail |
---|
void waitForResource() throws InterruptedException
InterruptedException
MapOutput<K,V> reserve(TaskAttemptID mapId, long requestedSize, int fetcher) throws IOException
mapId
- mapper from which data will be shuffled.requestedSize
- size in bytes of data that will be shuffled.fetcher
- id of the map output fetcher that will shuffle the data.
IOException
RawKeyValueIterator close() throws Throwable
Throwable
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |