Class/Object

io.eels.component.hive

HiveSource

Related Docs: object HiveSource | package hive

Permalink

case class HiveSource(dbName: String, tableName: String, partitionExprs: List[PartitionConstraint] = Nil, columnNames: Seq[String] = Nil, predicate: Option[Predicate] = None)(implicit fs: FileSystem, client: IMetaStoreClient) extends Source with Logging with Using with Product with Serializable

Linear Supertypes
Serializable, Serializable, Product, Equals, Using, Source, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. HiveSource
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. Using
  7. Source
  8. Logging
  9. AnyRef
  10. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new HiveSource(dbName: String, tableName: String, partitionExprs: List[PartitionConstraint] = Nil, columnNames: Seq[String] = Nil, predicate: Option[Predicate] = None)(implicit fs: FileSystem, client: IMetaStoreClient)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  7. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  8. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  9. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  10. val logger: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  11. lazy val metastoreSchema: Schema

    Permalink
  12. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  13. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  14. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  15. lazy val partitionKeys: List[String]

    Permalink
  16. def partitionMap(keys: Seq[String]): Map[String, Seq[String]]

    Permalink
  17. def partitionMap: Map[String, Seq[String]]

    Permalink
  18. def partitionValues(keys: Seq[String]): Seq[Seq[String]]

    Permalink

    Returns all partition values for the given partition keys.

    Returns all partition values for the given partition keys. This operation is optimized, in that it does not need to scan files, but can retrieve the information directly from the hive metastore.

  19. def partitionValues(key: String): Seq[String]

    Permalink

    Returns all partition values for a given partition key.

    Returns all partition values for a given partition key. This operation is optimized, in that it does not need to scan files, but can retrieve the information directly from the hive metastore.

  20. def partitions: List[Partition]

    Permalink
  21. def parts: Seq[Part]

    Permalink
    Definition Classes
    HiveSourceSource
  22. lazy val schema: Schema

    Permalink

    The returned schema should take into account:

    The returned schema should take into account:

    1) Any projection. If a projection is set, then it should return the schema in the same order as the projection. If no projection is set then the schema should be driven from the hive metastore.

    2) Any partitions set. These should be included in the schema columns.

    Definition Classes
    HiveSourceSource
  23. def spec: HiveSpec

    Permalink
  24. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  25. def toFrame(ioThreads: Int): Frame

    Permalink
    Definition Classes
    Source
  26. def using[T, U <: AnyRef { def close(): Unit }](closeable: U)(f: (U) ⇒ T): T

    Permalink
    Definition Classes
    Using
  27. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. def withColumns(first: String, rest: String*): HiveSource

    Permalink
  31. def withColumns(columns: Seq[String]): HiveSource

    Permalink
  32. def withPartitionConstraint(expr: PartitionConstraint): HiveSource

    Permalink
  33. def withPartitionConstraint(name: String, value: String): HiveSource

    Permalink
  34. def withPredicate(predicate: Predicate): HiveSource

    Permalink

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from Using

Inherited from Source

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped