api

Type Members

abstract class BasicDataQuantaBuilder[This <: DataQuantaBuilder[_, Out], Out] extends Logging with DataQuantaBuilder[This, Out]

Abstract base class for builders of DataQuanta.
Abstract base class for builders of DataQuanta. The purpose of the builders is to provide a convenient Java API for Rheem that compensates for lacking default and named arguments.
class CartesianDataQuantaBuilder[In0, In1] extends BasicDataQuantaBuilder[CartesianDataQuantaBuilder[In0, In1], Tuple2[In0, In1]]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.CartesianOperators.
class CoGroupDataQuantaBuilder[In0, In1, Key] extends BasicDataQuantaBuilder[CoGroupDataQuantaBuilder[In0, In1, Key], Tuple2[Iterable[In0], Iterable[In1]]]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.CoGroupOperators.
class CountDataQuantaBuilder[T] extends BasicDataQuantaBuilder[CountDataQuantaBuilder[T], Long]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.CountOperators.
class CustomOperatorDataQuantaBuilder[T] extends BasicDataQuantaBuilder[DataQuantaBuilder[_, T], T]

DataQuantaBuilder implementation for any org.qcri.rheem.core.plan.rheemplan.Operators.
DataQuantaBuilder implementation for any org.qcri.rheem.core.plan.rheemplan.Operators. Does not offer any convenience methods, though.
class DataQuanta[Out] extends AnyRef

Represents an intermediate result/data flow edge in a RheemPlan.
trait DataQuantaBuilder[+This <: DataQuantaBuilder[_, Out], Out] extends Logging

Trait/interface for builders of DataQuanta.
Trait/interface for builders of DataQuanta. The purpose of the builders is to provide a convenient Java API for Rheem that compensates for lacking default and named arguments.
class DistinctDataQuantaBuilder[T] extends BasicDataQuantaBuilder[DistinctDataQuantaBuilder[T], T]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.DistinctOperators.
class DoWhileDataQuantaBuilder[T, ConvOut] extends BasicDataQuantaBuilder[DoWhileDataQuantaBuilder[T, ConvOut], T]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.DoWhileOperators.
class FakeDataQuantaBuilder[T] extends BasicDataQuantaBuilder[FakeDataQuantaBuilder[T], T]

Wraps DataQuanta and exposes them as DataQuantaBuilder, i.e., this is an adapter.
class FilterDataQuantaBuilder[T] extends BasicDataQuantaBuilder[FilterDataQuantaBuilder[T], T]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.MapOperators.
class FlatMapDataQuantaBuilder[In, Out] extends BasicDataQuantaBuilder[FlatMapDataQuantaBuilder[In, Out], Out]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.FlatMapOperators.
class GlobalGroupDataQuantaBuilder[T] extends BasicDataQuantaBuilder[GlobalGroupDataQuantaBuilder[T], Iterable[T]]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.GlobalMaterializedGroupOperators.
class GlobalReduceDataQuantaBuilder[T] extends BasicDataQuantaBuilder[GlobalReduceDataQuantaBuilder[T], T]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.GlobalReduceOperators.
class GroupByDataQuantaBuilder[Key, T] extends BasicDataQuantaBuilder[GroupByDataQuantaBuilder[Key, T], Iterable[T]]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.MaterializedGroupByOperators.
class IntersectDataQuantaBuilder[T] extends BasicDataQuantaBuilder[IntersectDataQuantaBuilder[T], T]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.IntersectOperators.
class JavaPlanBuilder extends AnyRef

Utility to build and execute RheemPlans.
class JoinDataQuantaBuilder[In0, In1, Key] extends BasicDataQuantaBuilder[JoinDataQuantaBuilder[In0, In1, Key], Tuple2[In0, In1]]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.JoinOperators.
class JoinedDataQuanta[Out0, Out1] extends AnyRef

This class amends joined DataQuanta with additional operations.
class KeyedDataQuanta[Out, Key] extends AnyRef

This class provides operations on DataQuanta with additional operations.
class KeyedDataQuantaBuilder[Out, Key] extends AnyRef

This is not an actual DataQuantaBuilder but rather decorates such a DataQuantaBuilder with a key.
class LoadCollectionDataQuantaBuilder[Out] extends BasicDataQuantaBuilder[LoadCollectionDataQuantaBuilder[Out], Out]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.CollectionSources.
class MapDataQuantaBuilder[In, Out] extends BasicDataQuantaBuilder[MapDataQuantaBuilder[In, Out], Out]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.MapOperators.
class MapPartitionsDataQuantaBuilder[In, Out] extends BasicDataQuantaBuilder[MapPartitionsDataQuantaBuilder[In, Out], Out]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.MapPartitionsOperators.
class PlanBuilder extends AnyRef

Utility to build RheemPlans.
class ProjectRecordsDataQuantaBuilder extends BasicDataQuantaBuilder[ProjectRecordsDataQuantaBuilder, Record] with RecordDataQuantaBuilder[ProjectRecordsDataQuantaBuilder]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.MapOperators with org.qcri.rheem.basic.function.ProjectionDescriptors.
class ProjectionDataQuantaBuilder[In, Out] extends BasicDataQuantaBuilder[ProjectionDataQuantaBuilder[In, Out], Out]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.MapOperators with org.qcri.rheem.basic.function.ProjectionDescriptors.
class RecordDataQuanta extends AnyRef

This class enhances the functionality of DataQuanta with Records.
trait RecordDataQuantaBuilder[+This <: RecordDataQuantaBuilder[This]] extends DataQuantaBuilder[This, Record]

Enriches DataQuantaBuilder by Record-specific operations.
class RecordDataQuantaBuilderDecorator[This <: RecordDataQuantaBuilder[This]] extends DataQuantaBuilderDecorator[This, Record] with RecordDataQuantaBuilder[This]

This decorator enriches a regular DataQuantaBuilder with operations of a RecordDataQuantaBuilder.
class ReduceByDataQuantaBuilder[Key, T] extends BasicDataQuantaBuilder[ReduceByDataQuantaBuilder[Key, T], T]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.ReduceByOperators.
class RepeatDataQuantaBuilder[T] extends BasicDataQuantaBuilder[RepeatDataQuantaBuilder[T], T]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.DoWhileOperators.
class SampleDataQuantaBuilder[T] extends BasicDataQuantaBuilder[SampleDataQuantaBuilder[T], T]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.SampleOperators.
class SortDataQuantaBuilder[T, Key] extends BasicDataQuantaBuilder[SortDataQuantaBuilder[T, Key], T]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.SortOperators.
class UnarySourceDataQuantaBuilder[This <: DataQuantaBuilder[_, Out], Out] extends BasicDataQuantaBuilder[This, Out]

DataQuantaBuilder implementation for org.qcri.rheem.core.plan.rheemplan.UnarySources.
class UnionDataQuantaBuilder[T] extends BasicDataQuantaBuilder[UnionDataQuantaBuilder[T], T]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.UnionAllOperators.
class ZipWithIdDataQuantaBuilder[T] extends BasicDataQuantaBuilder[ZipWithIdDataQuantaBuilder[T], Tuple2[Long, T]]

DataQuantaBuilder implementation for org.qcri.rheem.basic.operators.ZipWithIdOperators.

Value Members

object DataQuanta
object PlanBuilder
implicit def basicDataUnitType[T](implicit classTag: ClassTag[T]): BasicDataUnitType[T]
implicit def createPlanBuilder(rheemContext: RheemContext): PlanBuilder
implicit def dataSetType[T](implicit classTag: ClassTag[T]): DataSetType[T]
implicit def elevateRecordDataQuanta(dataQuanta: DataQuanta[Record]): RecordDataQuanta
package graph

Provides implicits for Rheem's graph API.
implicit def groupedDataSetType[T](implicit classTag: ClassTag[T]): DataSetType[Iterable[T]]
implicit def groupedDataUnitType[T](implicit classTag: ClassTag[T]): DataUnitGroupType[T]
implicit def toCardinalityEstimator(f: (Long, Long) ⇒ Long): CardinalityEstimator
implicit def toCardinalityEstimator(f: (Long) ⇒ Long): CardinalityEstimator
implicit def toCardinalityEstimator(fixCardinality: Int): CardinalityEstimator
implicit def toCardinalityEstimator(fixCardinality: Long): CardinalityEstimator
implicit def toConsumer[T](scalaFunc: Function1[T, _]): Consumer[T]
implicit def toInterval(double: Double): ProbabilisticDoubleInterval
implicit def toJoinedDataQuanta[Out0, Out1](dataQuanta: DataQuanta[Tuple2[Out0, Out1]])(implicit arg0: ClassTag[Out0], arg1: ClassTag[Out1]): JoinedDataQuanta[Out0, Out1]
implicit def toLoadEstimator(f: (Long, Long, Long) ⇒ Long): LoadEstimator
implicit def toLoadEstimator(f: (Long, Long) ⇒ Long): LoadEstimator
implicit def toLoadProfileEstimator(f: (Long, Long, Long) ⇒ Long): LoadProfileEstimator
implicit def toLoadProfileEstimator(f: (Long, Long) ⇒ Long): LoadProfileEstimator
implicit def toSerializableBinaryOperator[T](scalaFunc: (T, T) ⇒ T): SerializableBinaryOperator[T]
implicit def toSerializableFlatteningFunction[In, Out](scalaFunc: (In) ⇒ Iterable[Out]): SerializableFunction[In, Iterable[Out]]
implicit def toSerializableFunction[In, Out](scalaFunc: (In) ⇒ Out): SerializableFunction[In, Out]
implicit def toSerializablePartitionFunction[In, Out](scalaFunc: (Iterable[In]) ⇒ Iterable[Out]): SerializableFunction[Iterable[In], Iterable[Out]]
implicit def toSerializablePredicate[T](scalaFunc: (T) ⇒ Boolean): SerializablePredicate[T]
package util

package api

Type Members

abstract class BasicDataQuantaBuilder[This <: DataQuantaBuilder[_, Out], Out] extends Logging with DataQuantaBuilder[This, Out]

class CartesianDataQuantaBuilder[In0, In1] extends BasicDataQuantaBuilder[CartesianDataQuantaBuilder[In0, In1], Tuple2[In0, In1]]

class CoGroupDataQuantaBuilder[In0, In1, Key] extends BasicDataQuantaBuilder[CoGroupDataQuantaBuilder[In0, In1, Key], Tuple2[Iterable[In0], Iterable[In1]]]

class CountDataQuantaBuilder[T] extends BasicDataQuantaBuilder[CountDataQuantaBuilder[T], Long]

class CustomOperatorDataQuantaBuilder[T] extends BasicDataQuantaBuilder[DataQuantaBuilder[_, T], T]

class DataQuanta[Out] extends AnyRef

trait DataQuantaBuilder[+This <: DataQuantaBuilder[_, Out], Out] extends Logging

class DistinctDataQuantaBuilder[T] extends BasicDataQuantaBuilder[DistinctDataQuantaBuilder[T], T]

class DoWhileDataQuantaBuilder[T, ConvOut] extends BasicDataQuantaBuilder[DoWhileDataQuantaBuilder[T, ConvOut], T]

class FakeDataQuantaBuilder[T] extends BasicDataQuantaBuilder[FakeDataQuantaBuilder[T], T]

class FilterDataQuantaBuilder[T] extends BasicDataQuantaBuilder[FilterDataQuantaBuilder[T], T]

class FlatMapDataQuantaBuilder[In, Out] extends BasicDataQuantaBuilder[FlatMapDataQuantaBuilder[In, Out], Out]

class GlobalGroupDataQuantaBuilder[T] extends BasicDataQuantaBuilder[GlobalGroupDataQuantaBuilder[T], Iterable[T]]

class GlobalReduceDataQuantaBuilder[T] extends BasicDataQuantaBuilder[GlobalReduceDataQuantaBuilder[T], T]

class GroupByDataQuantaBuilder[Key, T] extends BasicDataQuantaBuilder[GroupByDataQuantaBuilder[Key, T], Iterable[T]]

class IntersectDataQuantaBuilder[T] extends BasicDataQuantaBuilder[IntersectDataQuantaBuilder[T], T]

class JavaPlanBuilder extends AnyRef

class JoinDataQuantaBuilder[In0, In1, Key] extends BasicDataQuantaBuilder[JoinDataQuantaBuilder[In0, In1, Key], Tuple2[In0, In1]]

class JoinedDataQuanta[Out0, Out1] extends AnyRef

class KeyedDataQuanta[Out, Key] extends AnyRef

class KeyedDataQuantaBuilder[Out, Key] extends AnyRef

class LoadCollectionDataQuantaBuilder[Out] extends BasicDataQuantaBuilder[LoadCollectionDataQuantaBuilder[Out], Out]

class MapDataQuantaBuilder[In, Out] extends BasicDataQuantaBuilder[MapDataQuantaBuilder[In, Out], Out]

class MapPartitionsDataQuantaBuilder[In, Out] extends BasicDataQuantaBuilder[MapPartitionsDataQuantaBuilder[In, Out], Out]

class PlanBuilder extends AnyRef

class ProjectRecordsDataQuantaBuilder extends BasicDataQuantaBuilder[ProjectRecordsDataQuantaBuilder, Record] with RecordDataQuantaBuilder[ProjectRecordsDataQuantaBuilder]

class ProjectionDataQuantaBuilder[In, Out] extends BasicDataQuantaBuilder[ProjectionDataQuantaBuilder[In, Out], Out]

class RecordDataQuanta extends AnyRef

trait RecordDataQuantaBuilder[+This <: RecordDataQuantaBuilder[This]] extends DataQuantaBuilder[This, Record]

class RecordDataQuantaBuilderDecorator[This <: RecordDataQuantaBuilder[This]] extends DataQuantaBuilderDecorator[This, Record] with RecordDataQuantaBuilder[This]

class ReduceByDataQuantaBuilder[Key, T] extends BasicDataQuantaBuilder[ReduceByDataQuantaBuilder[Key, T], T]

class RepeatDataQuantaBuilder[T] extends BasicDataQuantaBuilder[RepeatDataQuantaBuilder[T], T]

class SampleDataQuantaBuilder[T] extends BasicDataQuantaBuilder[SampleDataQuantaBuilder[T], T]

class SortDataQuantaBuilder[T, Key] extends BasicDataQuantaBuilder[SortDataQuantaBuilder[T, Key], T]

class UnarySourceDataQuantaBuilder[This <: DataQuantaBuilder[_, Out], Out] extends BasicDataQuantaBuilder[This, Out]

class UnionDataQuantaBuilder[T] extends BasicDataQuantaBuilder[UnionDataQuantaBuilder[T], T]

class ZipWithIdDataQuantaBuilder[T] extends BasicDataQuantaBuilder[ZipWithIdDataQuantaBuilder[T], Tuple2[Long, T]]

Value Members

object DataQuanta

object PlanBuilder

implicit def basicDataUnitType[T](implicit classTag: ClassTag[T]): BasicDataUnitType[T]

implicit def createPlanBuilder(rheemContext: RheemContext): PlanBuilder

implicit def dataSetType[T](implicit classTag: ClassTag[T]): DataSetType[T]

implicit def elevateRecordDataQuanta(dataQuanta: DataQuanta[Record]): RecordDataQuanta

package graph

implicit def groupedDataSetType[T](implicit classTag: ClassTag[T]): DataSetType[Iterable[T]]

implicit def groupedDataUnitType[T](implicit classTag: ClassTag[T]): DataUnitGroupType[T]

implicit def toCardinalityEstimator(f: (Long, Long) ⇒ Long): CardinalityEstimator

implicit def toCardinalityEstimator(f: (Long) ⇒ Long): CardinalityEstimator

implicit def toCardinalityEstimator(fixCardinality: Int): CardinalityEstimator

implicit def toCardinalityEstimator(fixCardinality: Long): CardinalityEstimator

implicit def toConsumer[T](scalaFunc: Function1[T, _]): Consumer[T]

implicit def toInterval(double: Double): ProbabilisticDoubleInterval

implicit def toJoinedDataQuanta[Out0, Out1](dataQuanta: DataQuanta[Tuple2[Out0, Out1]])(implicit arg0: ClassTag[Out0], arg1: ClassTag[Out1]): JoinedDataQuanta[Out0, Out1]

implicit def toLoadEstimator(f: (Long, Long, Long) ⇒ Long): LoadEstimator

implicit def toLoadEstimator(f: (Long, Long) ⇒ Long): LoadEstimator

implicit def toLoadProfileEstimator(f: (Long, Long, Long) ⇒ Long): LoadProfileEstimator

implicit def toLoadProfileEstimator(f: (Long, Long) ⇒ Long): LoadProfileEstimator

implicit def toSerializableBinaryOperator[T](scalaFunc: (T, T) ⇒ T): SerializableBinaryOperator[T]

implicit def toSerializableFlatteningFunction[In, Out](scalaFunc: (In) ⇒ Iterable[Out]): SerializableFunction[In, Iterable[Out]]

implicit def toSerializableFunction[In, Out](scalaFunc: (In) ⇒ Out): SerializableFunction[In, Out]

implicit def toSerializablePartitionFunction[In, Out](scalaFunc: (Iterable[In]) ⇒ Iterable[Out]): SerializableFunction[Iterable[In], Iterable[Out]]

implicit def toSerializablePredicate[T](scalaFunc: (T) ⇒ Boolean): SerializablePredicate[T]

package util

Inherited from AnyRef

Inherited from Any

Ungrouped