org.apache.spark.sql.catalyst.catalog

InMemoryCatalog

class InMemoryCatalog extends ExternalCatalog

An in-memory (ephemeral) implementation of the system catalog.

This is a dummy implementation that does not require setting up external systems. It is intended for testing or exploration purposes only and should not be used in production.

All public methods should be synchronized for thread-safety.

Linear Supertypes
ExternalCatalog, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. InMemoryCatalog
  2. ExternalCatalog
  3. AnyRef
  4. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new InMemoryCatalog(hadoopConfig: Configuration = ...)

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. def alterDatabase(dbDefinition: CatalogDatabase): Unit

    Alter a database whose name matches the one specified in dbDefinition, assuming the database exists.

    Alter a database whose name matches the one specified in dbDefinition, assuming the database exists.

    Note: If the underlying implementation does not support altering a certain field, this becomes a no-op.

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  7. def alterPartitions(db: String, table: String, parts: Seq[CatalogTablePartition]): Unit

    Alter one or many table partitions whose specs that match those specified in parts, assuming the partitions exist.

    Alter one or many table partitions whose specs that match those specified in parts, assuming the partitions exist.

    Note: If the underlying implementation does not support altering a certain field, this becomes a no-op.

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  8. def alterTable(db: String, tableDefinition: CatalogTable): Unit

    Alter a table whose name that matches the one specified in tableDefinition, assuming the table exists.

    Alter a table whose name that matches the one specified in tableDefinition, assuming the table exists.

    Note: If the underlying implementation does not support altering a certain field, this becomes a no-op.

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  9. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  10. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  11. def createDatabase(dbDefinition: CatalogDatabase, ignoreIfExists: Boolean): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  12. def createFunction(db: String, func: CatalogFunction): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  13. def createPartitions(db: String, table: String, parts: Seq[CatalogTablePartition], ignoreIfExists: Boolean): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  14. def createTable(db: String, tableDefinition: CatalogTable, ignoreIfExists: Boolean): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  15. def databaseExists(db: String): Boolean

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  16. def dropDatabase(db: String, ignoreIfNotExists: Boolean, cascade: Boolean): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  17. def dropFunction(db: String, funcName: String): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  18. def dropPartitions(db: String, table: String, partSpecs: Seq[TablePartitionSpec], ignoreIfNotExists: Boolean): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  19. def dropTable(db: String, table: String, ignoreIfNotExists: Boolean): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  20. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  21. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  22. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  23. def functionExists(db: String, funcName: String): Boolean

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  24. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  25. def getDatabase(db: String): CatalogDatabase

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  26. def getFunction(db: String, funcName: String): CatalogFunction

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  27. def getPartition(db: String, table: String, spec: TablePartitionSpec): CatalogTablePartition

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  28. def getTable(db: String, table: String): CatalogTable

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  29. def getTableOption(db: String, table: String): Option[CatalogTable]

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  30. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  31. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  32. def listDatabases(pattern: String): Seq[String]

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  33. def listDatabases(): Seq[String]

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  34. def listFunctions(db: String, pattern: String): Seq[String]

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  35. def listPartitions(db: String, table: String, partialSpec: Option[TablePartitionSpec] = None): Seq[CatalogTablePartition]

    List the metadata of all partitions that belong to the specified table, assuming it exists.

    List the metadata of all partitions that belong to the specified table, assuming it exists.

    A partial partition spec may optionally be provided to filter the partitions returned. For instance, if there exist partitions (a='1', b='2'), (a='1', b='3') and (a='2', b='4'), then a partial spec of (a='1') will return the first two only.

    db

    database name

    table

    table name

    partialSpec

    partition spec

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  36. def listTables(db: String, pattern: String): Seq[String]

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  37. def listTables(db: String): Seq[String]

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  38. def loadPartition(db: String, table: String, loadPath: String, partition: TablePartitionSpec, isOverwrite: Boolean, holdDDLTime: Boolean, inheritTableSpecs: Boolean, isSkewedStoreAsSubdir: Boolean): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  39. def loadTable(db: String, table: String, loadPath: String, isOverwrite: Boolean, holdDDLTime: Boolean): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  40. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  41. final def notify(): Unit

    Definition Classes
    AnyRef

  42. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  43. def renameFunction(db: String, oldName: String, newName: String): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  44. def renamePartitions(db: String, table: String, specs: Seq[TablePartitionSpec], newSpecs: Seq[TablePartitionSpec]): Unit

    Override the specs of one or many existing table partitions, assuming they exist.

    Override the specs of one or many existing table partitions, assuming they exist. This assumes index i of specs corresponds to index i of newSpecs.

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  45. def renameTable(db: String, oldName: String, newName: String): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  46. def requireDbExists(db: String): Unit

    Attributes
    protected
    Definition Classes
    ExternalCatalog

  47. def setCurrentDatabase(db: String): Unit

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  48. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  49. def tableExists(db: String, table: String): Boolean

    Definition Classes
    InMemoryCatalog → ExternalCatalog

  50. def toString(): String

    Definition Classes
    AnyRef → Any

  51. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  52. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  53. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from ExternalCatalog

Inherited from AnyRef

Inherited from Any

Ungrouped