pipes

Type Members

1. abstract class Basis[-I] extends DataPipe[I, DenseVector[Double]]

   

   Defines an abstract type for a basis expansion/mapping.

2. trait BifurcationPipe[-Source, +Result1, +Result2] extends DataPipe[Source, (Result1, Result2)]

   

3. trait DataPipe[-Source, +Destination] extends DataPipeConvertible[Source, Destination] with Serializable

   

   Top level trait representing an abstract pipe that defines a transformation between two data types, i.e.

   Top level trait representing an abstract pipe that defines a transformation between two data types, i.e. Source and Destination

4. trait DataPipe2[-Source1, -Source2, +Result] extends DataPipeConvertible[(Source1, Source2), Result] with Serializable

   

5. trait DataPipe3[-Source1, -Source2, -Source3, +Result] extends DataPipeConvertible[(Source1, Source2, Source3), Result] with Serializable

   

6. trait DataPipe4[-Source1, -Source2, -Source3, -Source4, +Result] extends DataPipeConvertible[(Source1, Source2, Source3, Source4), Result] with Serializable

   

7. trait DataPipeConvertible[-Source, +Destination] extends AnyRef

   

8. trait Encoder[S, D] extends DataPipe[S, D]

   

   A deterministic and reversible encoding from a domain to a range.

   A deterministic and reversible encoding from a domain to a range. Mathematically equivalent to a bijective function.

   S

   The domain type

   D

   The output type

9. trait MetaPipe[Source, Intermediate, Destination] extends DataPipe[Source, DataPipe[Intermediate, Destination]]

   

   Data Pipe wrapper of a curried function of order 1

10. trait MetaPipe12[A, B, C, D] extends DataPipe[A, DataPipe2[B, C, D]]

    

    Wraps a curried function of order 1 which takes 1 arguments and returns a Function2.

11. trait MetaPipe21[A, B, C, D] extends DataPipe2[A, B, DataPipe[C, D]]

    

    Wraps a curried function of order 1 which takes 2 arguments and returns a Function1.

12. trait ParallelPipe[-Source1, +Result1, -Source2, +Result2] extends DataPipe[(Source1, Source2), (Result1, Result2)]

    

13. trait RDDFilterPipe[Element] extends RDDPipe[Element, RDD[Element]]

    

14. trait RDDMapPipe[Element, OtherElement] extends RDDPipe[Element, RDD[OtherElement]]

    

    A pipeline which takes an RDD of Element and maps it to an RDD of OtherElement.

15. trait RDDPipe[Element, Result] extends DataPipe[RDD[Element], Result]

    

16. sealed trait Reducer extends ReducerPipe[Double]

    

17. trait ReducerPipe[I] extends DataPipe[Array[I], I]

    

18. trait ReversibleScaler[S] extends Scaler[S] with Encoder[S, S]

    

19. trait Scaler[S] extends DataPipe[S, S]

    

20. trait SideEffectPipe[I] extends DataPipe[I, Unit]

    

21. trait StreamDataPipe[I, J, K] extends DataPipe[Stream[I], K]

    
    I

    The type of a single source record

    J

    The result type of a single record.

22. trait StreamFilterPipe[I] extends StreamDataPipe[I, Boolean, Stream[I]]

    

23. trait StreamFlatMapPipe[I, J] extends StreamDataPipe[I, Stream[J], Stream[J]]

    

    A pipeline which takes a Stream of data and performs the scala flatMap operation.

24. trait StreamMapPipe[I, J] extends StreamDataPipe[I, J, Stream[J]]

    

    A pipeline which takes a Stream of data and performs the scala mapoperation.

25. trait StreamPartitionPipe[I] extends StreamDataPipe[I, Boolean, (Stream[I], Stream[I])]

    

26. trait StreamSideEffectPipe[I] extends StreamDataPipe[I, Unit, Unit]

    

27. case class TupleIntegerEncoder(arities: List[Int]) extends Encoder[List[Int], Int] with Product with Serializable

    

28. case class WeightedSumReducer(weights: Array[Double]) extends Reducer with Product with Serializable