com.coxautodata.waimak.metastore
Force drop+create of tables even if update is called (necessary in cases of schema change)
Takes a value of type A and a msg to log, returning a and logging the message at the desired level
Takes a value of type A and a msg to log, returning a and logging the message at the desired level
a
Takes a value of type A and a function message from A to String, logs the value of invoking message(a) at the level described by the level parameter
Takes a value of type A and a function message from A to String, logs the value of invoking message(a) at the level described by the level parameter
a
logAndReturn(1, (num: Int) => s"number: $num", Info) // In the log we would see a log corresponding to "number 1"
Recreate a table from parquet files, inferring the schema from the parquet.
Recreate a table from parquet files, inferring the schema from the parquet. Table is dropped if it exists and then recreated.
name of the table
path of the table location
optional list of partition columns
the sql statements which need executing to perform the table recreation
Submit a query that returns no results (i.e.
Submit a query that returns no results (i.e. schema change operations) Exceptions will be thrown if the query fails
SQL ddl as a string
Update the data location of a parquet table.
Update the data location of a parquet table. If the table is partitioned, it will be dropped if it exists and recreated. If the table is not partitioned and forceRecreateTables is true, it will be dropped if it exists and recreated. If the table is not partitioned and forceRecreateTables is false, then the data location will be changed without dropping the table. The table will be created if it does not already exist.
name of the table
path of the table location
optional list of partition columns
the sql statements which need executing to perform the table update
Hadoop database connection trait that has Hadoop-specific table functions (i.e. create parquet tables)