Generate all extraction scripts based on the given domain
Generate all extraction scripts based on the given domain
The domain extracted from the Excel referential file
The script template
Where the scripts are produced
Defaut delta column
Mapping table name -> delta column, has precedence over defaultDeltaColumn
The list of produced files
Generate all extraction scripts based on the given domain
Generate all extraction scripts based on the given domain
The job extracted from the yml file
The script template
The list of produced files
Fills a Mustache templated file based on a given domain.
Fills a Mustache templated file based on a given domain. The following documentation considers that we use the script to generate SQL export files.
The schemas should at least, specify :
You also have to provide a Mustache (http://mustache.github.io/mustache.5.html) template file.
Here you'll write your extraction export process (sqlplus for Oracle, pgsql for PostgreSQL as an example). In that template you can use the following parameters:
table_name -> the table to export delimiter -> the resulting dsv file delimiter columns -> the columns to export columns is a Mustache map, it gives you access, for each column, to:
Usage: comet [script-gen] [options]
Command: script-gen --domain <value> The domain for which to generate extract scripts --templateFile <value> Script template file --scriptsOutputDir <value> Scripts output folder --deltaColumn <value> The date column which is used to determine new rows for each exports (can be passed table by table as config element)
Generate an extraction script payload based on a template and its params
Generate an extraction script payload based on a template and its params
The extraction script template
Its params
The produced script payload