eels

Type Members

1. trait Aggregation extends AnyRef

   

2. trait CloseableIterator[+T] extends AnyRef

   

3. case class DataTypeRule(pattern: String, dataType: DataType, nullable: Boolean = true) extends Product with Serializable

   

4. abstract class DefaultAggregation extends Aggregation

   

5. case class FilePattern(pattern: String, filter: (Path) ⇒ Boolean = _ => true) extends Logging with Product with Serializable

   

6. trait Frame extends AnyRef

   

7. trait GroupedFrame extends AnyRef

   

8. trait Listener extends AnyRef

   

9. trait Part extends AnyRef

   

   A Part represents part of the source data.

   A Part represents part of the source data. Eg a single file in a multi-file source, or a single table in a multi-table source. Splitting sources into parts allows them to be read concurrently, therefore, implementations must ensure that different parts can be safely read in parallel. A single part is always read by a single thread.

10. case class Row(schema: StructType, values: Seq[Any]) extends Product with Serializable

    

11. class RowBuilder extends AnyRef

    

12. trait SchemaInferrer extends AnyRef

    

13. trait Sink extends Using

    

14. trait SinkWriter extends AnyRef

    

15. trait Source extends Logging

    

    A Source is a provider of data.

    A Source is a provider of data.

    A source implementation must provide two methods:

    1: schema() which returns an eel schema for the data source.

    2: parts() which returns zero or more Part instances representing the data.

    A part instance is a subset of the data in a Source, and allows for concurrent reading of that data. For example a part could be a single file in a multi-file source, or a partition in a partitioned source.

16. class SourceFrame extends Frame with Logging