com.twitter.scalding

reducer_estimation

package reducer_estimation

Visibility
  1. Public
  2. All

Type Members

  1. case class FallbackEstimator(first: ReducerEstimator, fallback: ReducerEstimator) extends ReducerEstimator with Product with Serializable

  2. sealed trait FlowStepHistory extends AnyRef

    Info about a prior FlowStep, provided by implementers of HistoryService

  3. case class FlowStrategyInfo(flow: Flow[JobConf], predecessorSteps: Seq[FlowStep[JobConf]], step: FlowStep[JobConf]) extends Product with Serializable

  4. trait HistoryService extends AnyRef

    Provider of information about prior runs.

  5. class InputSizeReducerEstimator extends ReducerEstimator

    Estimator that uses the input size and a fixed "bytesPerReducer" target.

  6. abstract class RatioBasedEstimator extends InputSizeReducerEstimator with HistoryService

  7. class ReducerEstimator extends AnyRef

Value Members

  1. object EstimatorConfig

  2. object FlowStepHistory

  3. object InputSizeReducerEstimator

  4. object RatioBasedEstimator

  5. object ReducerEstimatorStepStrategy extends FlowStepStrategy[JobConf]

Ungrouped