io.eels.component.hive

HiveOps

object HiveOps extends StrictLogging

Linear Supertypes
StrictLogging, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. HiveOps
  2. StrictLogging
  3. Logging
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. def addColumn(dbName: String, tableName: String, column: Column)(implicit client: IMetaStoreClient): Unit

    Adds this column to the hive schema.

    Adds this column to the hive schema. This is schema evolution. The column must be marked as nullable and cannot have the same name as an existing column.

  7. def applySpec(spec: HiveSpec, overwrite: Boolean)(implicit client: IMetaStoreClient): Unit

  8. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  9. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  10. def createPartition(dbName: String, tableName: String, partition: Partition, location: Path)(implicit client: IMetaStoreClient): Unit

    Creates a new partition in Hive in the given database:table.

    Creates a new partition in Hive in the given database:table. The location of the partition must be specified. If you want to use the default location then use the other variant that doesn't require the location path. The values for the serialzation formats are taken from the values for the table.

  11. def createPartition(dbName: String, tableName: String, partition: Partition)(implicit client: IMetaStoreClient): Unit

    Creates a new partition in Hive in the given database:table in the default location, which will be the partition key values as a subdirectory of the table location.

    Creates a new partition in Hive in the given database:table in the default location, which will be the partition key values as a subdirectory of the table location. The values for the serialzation formats are taken from the values for the table.

  12. def createPartitionIfNotExists(dbName: String, tableName: String, parts: Seq[PartitionPart])(implicit client: IMetaStoreClient): Unit

  13. def createTable(databaseName: String, tableName: String, schema: Schema, partitionKeys: List[String] = Nil, format: HiveFormat = HiveFormat.Text, props: Map[String, String] = Map.empty, tableType: TableType = TableType.MANAGED_TABLE, location: Option[String] = None, overwrite: Boolean = false)(implicit client: IMetaStoreClient): Boolean

  14. def createTimeAsInt: Int

  15. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  16. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  17. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  18. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  19. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  20. def hivePartitions(dbName: String, tableName: String)(implicit client: IMetaStoreClient): List[org.apache.hadoop.hive.metastore.api.Partition]

  21. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  22. def location(dbName: String, tableName: String)(implicit client: IMetaStoreClient): String

  23. val logger: Logger

    Attributes
    protected
    Definition Classes
    StrictLogging → Logging
  24. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  25. final def notify(): Unit

    Definition Classes
    AnyRef
  26. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  27. def partitionExists(dbName: String, tableName: String, parts: Seq[PartitionPart])(implicit client: IMetaStoreClient): Boolean

  28. def partitionKeyNames(dbName: String, tableName: String)(implicit client: IMetaStoreClient): List[String]

  29. def partitionKeys(dbName: String, tableName: String)(implicit client: IMetaStoreClient): List[FieldSchema]

  30. def partitionMap(dbName: String, tableName: String)(implicit client: IMetaStoreClient): Map[String, Set[String]]

    Returns a map of all partition keys to their values.

    Returns a map of all partition keys to their values. This operation is optimized, in that it does not need to scan files, but can retrieve the information directly from the hive metastore.

  31. def partitionPath(dbName: String, tableName: String, parts: Seq[PartitionPart], tablePath: Path): Path

  32. def partitionPath(dbName: String, tableName: String, parts: Seq[PartitionPart])(implicit client: IMetaStoreClient): Path

  33. def partitionPathString(dbName: String, tableName: String, parts: Seq[PartitionPart], tablePath: Path): String

  34. def partitionValues(dbName: String, tableName: String, key: String)(implicit client: IMetaStoreClient): Set[String]

    Returns all partition values for a given partition key.

    Returns all partition values for a given partition key. This operation is optimized, in that it does not need to scan files, but can retrieve the information directly from the hive metastore.

  35. def partitionValues(dbName: String, tableName: String, keys: Seq[String])(implicit client: IMetaStoreClient): List[Set[String]]

    Returns all partition values for the given partition keys.

    Returns all partition values for the given partition keys. This operation is optimized, in that it does not need to scan files, but can retrieve the information directly from the hive metastore.

  36. def partitions(dbName: String, tableName: String)(implicit client: IMetaStoreClient): List[Partition]

  37. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  38. def tableExists(databaseName: String, tableName: String)(implicit client: IMetaStoreClient): Boolean

  39. def tableFormat(dbName: String, tableName: String)(implicit client: IMetaStoreClient): String

  40. def tablePath(dbName: String, tableName: String)(implicit client: IMetaStoreClient): Path

  41. def toString(): String

    Definition Classes
    AnyRef → Any
  42. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  43. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  44. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from StrictLogging

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped