Package org.apache.flink.runtime.operators

Class ReduceCombineDriver<T>

  • Type Parameters:
    T - The data type consumed and produced by the combiner.
    All Implemented Interfaces:
    Driver<org.apache.flink.api.common.functions.ReduceFunction<T>,​T>
    public class ReduceCombineDriver<T>
extends Object
implements Driver<org.apache.flink.api.common.functions.ReduceFunction<T>,​T>
    Combine operator for Reduce functions, standalone (not chained). Sorts and groups and reduces data, but never spills the sort. May produce multiple partially aggregated groups.

    • Constructor Detail

      • ReduceCombineDriver

        public ReduceCombineDriver()

    • Method Detail

      • setup

        public void setup​(TaskContext<org.apache.flink.api.common.functions.ReduceFunction<T>,​T> context)
        Specified by:
        setup in interface Driver<org.apache.flink.api.common.functions.ReduceFunction<T>,​T>

      • getNumberOfInputs

        public int getNumberOfInputs()
        Description copied from interface: Driver
        Gets the number of inputs that the task has.
        Specified by:
        getNumberOfInputs in interface Driver<org.apache.flink.api.common.functions.ReduceFunction<T>,​T>
        Returns:
        The number of inputs.

      • getStubType

        public Class<org.apache.flink.api.common.functions.ReduceFunction<T>> getStubType()
        Description copied from interface: Driver
        Gets the class of the stub type that is run by this task. For example, a MapTask should return MapFunction.class.
        Specified by:
        getStubType in interface Driver<org.apache.flink.api.common.functions.ReduceFunction<T>,​T>
        Returns:
        The class of the stub type run by the task.

      • getNumberOfDriverComparators

        public int getNumberOfDriverComparators()
        Description copied from interface: Driver
        Gets the number of comparators required for this driver.
        Specified by:
        getNumberOfDriverComparators in interface Driver<org.apache.flink.api.common.functions.ReduceFunction<T>,​T>
        Returns:
        The number of comparators required for this driver.

      • prepare

        public void prepare()
             throws Exception
        Description copied from interface: Driver
        This method is called before the user code is opened. An exception thrown by this method signals failure of the task.
        Specified by:
        prepare in interface Driver<org.apache.flink.api.common.functions.ReduceFunction<T>,​T>
        Throws:
        Exception - Exceptions may be forwarded and signal task failure.

      • run

        public void run()
         throws Exception
        Description copied from interface: Driver
        The main operation method of the task. It should call the user code with the data subsets until the input is depleted.
        Specified by:
        run in interface Driver<org.apache.flink.api.common.functions.ReduceFunction<T>,​T>
        Throws:
        Exception - Any exception thrown by this method signals task failure. Because exceptions in the user code typically signal situations where this instance in unable to proceed, exceptions from the user code should be forwarded.

      • cleanup

        public void cleanup()
        Description copied from interface: Driver
        This method is invoked in any case (clean termination and exception) at the end of the tasks operation.
        Specified by:
        cleanup in interface Driver<org.apache.flink.api.common.functions.ReduceFunction<T>,​T>

      • cancel

        public void cancel()
        Description copied from interface: Driver
        This method is invoked when the driver must aborted in mid processing. It is invoked asynchronously by a different thread.
        Specified by:
        cancel in interface Driver<org.apache.flink.api.common.functions.ReduceFunction<T>,​T>