datalake

Type Members

1. trait DataLink extends SparkSessions

   

   A reference to data with the functionality to read and write

2. case class DataUID(namespace: String, key: String) extends Product with Serializable

   

   A reference that allows you to fetch a DataLink from your environment

3. trait Datalake extends AnyRef

   

   Interface containing all the configuration for a given environment

4. class FileSystemDataLink extends PathBasedDataLink

   

   Reference to data stored on the file system

5. class HiveDataLink extends PathBasedDataLink

   

   Reference to data stored on hive

6. class JdbcDataLink extends DataLink

   

   Default JDBC DataRef implementation for reading and writing to a JDBC database

7. type LazyConfig[T] = () ⇒ T

   

8. class NullDataLink extends DataLink

   

   DataLink implementation with no effect for testing purposes

9. trait PathBasedDataLink extends DataLink

   

10. class SnapshotDataLink extends PathBasedDataLink