typedsql

Type Members

1. trait CompiledSqlQuery extends AnyRef

   

2. sealed abstract class DataSource[T <: ThriftStruct] extends AnyRef

   

   A Data Source is something that can be queried to produce a dataset on HDFS either as a Hive table or a Typed Pipe.

3. case class HiveQueryDataSource[T <: ThriftStruct](query: String, parameters: Map[String, String], sources: Map[String, DataSource[_]], udfs: Map[String, Class[GenericUDF]], partitions: List[(String, String)] = Nil, hiveViewName: Option[String] = None, hiveTableName: Option[String] = None, hdfsPath: Option[String] = None)(implicit evidence$15: Manifest[T], evidence$16: HasStructType[T]) extends DataSource[T] with HiveViewSource[T] with PersistableSource[T] with Product with Serializable

   

   Compiled and parameterised Hive query with defined sources.

4. case class HiveView[T <: ThriftStruct](hiveTable: String)(implicit evidence$11: Manifest[T], evidence$12: HasStructType[T]) extends DataSource[T] with HiveViewSource[T] with Product with Serializable

   

   A Hive view that has been persisted/created.

   A Hive view that has been persisted/created.

   T

   type of output records.

   hiveTable

   name in the Hive metastore (including database).

5. sealed trait HiveViewSource[T <: ThriftStruct] extends AnyRef

   

   A source that can be represented/used as a Hive view (e.g.

   A source that can be represented/used as a Hive view (e.g. does not require materialisation).

6. case class MaterialisedHiveTable[T <: ThriftStruct](hdfsPath: String, hiveTable: String, partitions: List[(String, String)] = Nil)(implicit evidence$9: Manifest[T], evidence$10: HasStructType[T]) extends DataSource[T] with Product with Serializable

   

   A Hive table that has been persisted/already exists on HDFS.

   A Hive table that has been persisted/already exists on HDFS.

   hdfsPath

   path to dataset on HDFS

   hiveTable

   fully qualified name (e.g. db.tablename)

7. class ParameterMapping extends AnyRef

   

8. sealed trait PersistableSource[T <: ThriftStruct] extends AnyRef

   

9. case class PersistedDataSource[T <: ThriftStruct](underlying: PersistableSource[T], strategy: Strategy[T])(implicit evidence$17: Manifest[T], evidence$18: HasStructType[T]) extends DataSource[T] with Product with Serializable

   

   A Data Source that wraps an underlying implementation and applies a strategy to decide whether to execute the underlying data source or to use a cache/stale data.

10. class ScroogeGenerator[Context <: Context] extends AnyRef

    

11. class SourceMapping[C <: Context] extends AnyRef

    

12. case class SqlParameter[T](write: (T) ⇒ String) extends Product with Serializable

    

13. macro class SqlQuery extends Annotation with StaticAnnotation

    

    Annotations

    @compileTimeOnly( ... ) @compileTimeOnly( ... )

14. case class TypedPipeDataSource[T <: ThriftStruct](pipe: TypedPipe[T], partitions: List[(String, String)] = Nil, hiveTableName: Option[String] = None, hdfsPath: Option[String] = None)(implicit evidence$13: Manifest[T], evidence$14: HasStructType[T]) extends DataSource[T] with PersistableSource[T] with Product with Serializable

    

    Generic Scalding Typed Pipe source.

    Generic Scalding Typed Pipe source. Will be persisted to disk on first use as a Hive table.

15. class UDF extends Annotation with StaticAnnotation

    

16. class UDFMapping[C <: Context] extends AnyRef