eels

Type Members

1. case class AndPredicate(predicates: Seq[Predicate]) extends Predicate with Product with Serializable

   

2. class BasicSchemaInferrer extends SchemaInferrer

   

3. case class DataTable(schema: StructType, records: Seq[Record]) extends Product with Serializable

   

4. case class DataTypeRule(pattern: String, dataType: DataType, nullable: Boolean = true) extends Product with Serializable

   

5. case class EqualsPredicate(name: String, value: Any) extends NamedPredicate with Product with Serializable

   

6. case class FilePattern(pattern: String, filter: (Path) ⇒ Boolean = _ => true) extends Logging with Product with Serializable

   

7. case class GroupStats[T](min: T, max: T) extends Product with Serializable

   

8. case class GtPredicate(name: String, value: Any) extends NamedPredicate with Product with Serializable

   

9. case class GtePredicate(name: String, value: Any) extends NamedPredicate with Product with Serializable

   

10. trait Listener extends AnyRef

    

11. case class LtPredicate(name: String, value: Any) extends NamedPredicate with Product with Serializable

    

12. case class LtePredicate(name: String, value: Any) extends NamedPredicate with Product with Serializable

    

13. abstract class NamedPredicate extends Predicate

    

14. case class NotEqualsPredicate(name: String, value: Any) extends NamedPredicate with Product with Serializable

    

15. case class NotPredicate(inner: Predicate) extends Predicate with Product with Serializable

    

16. case class OrPredicate(predicates: Seq[Predicate]) extends Predicate with Product with Serializable

    

17. trait Part extends AnyRef

    

    A Part represents part of the source data.

    A Part represents part of the source data. Eg a single file in a multi-file source, or a single table in a multi-table source. Splitting sources into parts allows them to be read concurrently, therefore, implementations must ensure that different parts can be safely read in parallel. A single part is always read by a single thread.

18. sealed trait Predicate extends AnyRef

    

19. trait PredicateBuilder[T] extends AnyRef

    

20. case class Record(values: Seq[Any]) extends Product with Serializable

    

21. case class Row(schema: StructType, values: Seq[Any]) extends Product with Serializable

    

22. trait SchemaInferrer extends AnyRef

    

23. trait Sink extends Using

    

24. trait SinkWriter extends AnyRef

    

    A RowWriter writes Rows to some storage area.

    A RowWriter writes Rows to some storage area.

    It does not need to be thread safe, callers must guarantee that only a single thread will invoke a particular writer at a time.

    RowWriters can be implemented as lazy if required, so that file handles, etc, are not opened until the first record is written.

25. trait Source extends Logging

    

    A Source is a provider of data.

    A Source is a provider of data.

    A source implementation must provide two methods:

    1: schema() which returns an eel schema for the data source.

    2: parts() which returns zero or more Part instances representing the data.

    A part instance is a subset of the data in a Source, and allows for concurrent reading of that data. For example a part could be a single file in a multi-file source, or a partition in a partitioned source.

26. trait UserDefinedPredicate[T] extends Predicate with Serializable