Package

io.eels.component

hive

Permalink

package hive

Visibility
  1. Public
  2. All

Type Members

  1. case class HiveDatabase(dbName: String)(implicit fs: FileSystem, client: IMetaStoreClient) extends Product with Serializable

    Permalink
  2. case class HiveDatasetUri(db: String, table: String) extends Product with Serializable

    Permalink
  3. trait HiveDialect extends Logging

    Permalink
  4. class HiveFilePart extends Part

    Permalink

  5. trait HiveFormat extends AnyRef

    Permalink
  6. class HiveOps extends Logging

    Permalink
  7. class HivePartitionPart extends Part with Logging

    Permalink

    A Hive Part that can read values from the metastore, rather than reading values from files.

    A Hive Part that can read values from the metastore, rather than reading values from files. This can be used only when the requested fields are all partition partitionKeys.

  8. case class HiveSink(dbName: String, tableName: String, ioThreads: Int = 4, dynamicPartitioning: Option[Boolean] = None, schemaEvolution: Option[Boolean] = None)(implicit fs: FileSystem, client: IMetaStoreClient) extends Sink with Logging with Product with Serializable

    Permalink
  9. class HiveSinkWriter extends SinkWriter with Logging

    Permalink
  10. case class HiveSource(dbName: String, tableName: String, constraints: List[PartitionConstraint] = Nil, projection: List[String] = Nil, predicate: Option[Predicate] = None)(implicit fs: FileSystem, client: IMetaStoreClient) extends Source with Logging with Using with Product with Serializable

    Permalink

    constraints

    optional constraits on the partition data to narrow which partitions are read

    projection

    sets which fields are required by the caller.

    predicate

    optional predicate which will filter rows at the read level

  11. case class HiveTable(dbName: String, tableName: String)(implicit fs: FileSystem, client: IMetaStoreClient) extends Product with Serializable

    Permalink
  12. trait HiveWriter extends AnyRef

    Permalink

Value Members

  1. object HiveDDL

    Permalink
  2. object HiveDatasetUri extends Serializable

    Permalink
  3. object HiveDialect extends Logging

    Permalink
  4. object HiveFileScanner extends Logging

    Permalink
  5. object HiveFilesFn extends Logging

    Permalink

    Locates files for a given table.

    Locates files for a given table. Connects to the hive metastore to get the partitions list (or if no partitions then just root) and scans those directories. Delegates the directory scan itself to a HiveFileScanner

  6. object HiveFormat

    Permalink
  7. object HiveSchemaFns extends Logging

    Permalink
  8. object HiveSink extends Serializable

    Permalink
  9. object PartitionPartsFn extends Logging

    Permalink
  10. package dialect

    Permalink

Ungrouped