Airflow Launcher will submit a request for ingestion to Airflow using the REST API.
Airflow Launcher will submit a request for ingestion to Airflow using the REST API. The requested DAG must exist in Airflow first.
HDFS Filesystem Handler
Interface required for any cron job launcher
Handles access to datasets metadata, eq.
Handles access to datasets metadata, eq. domains / types / schemas.
Simple Launcher will directly invoke the ingestion method wityhout using a cron manager.
Simple Launcher will directly invoke the ingestion method wityhout using a cron manager. This is userfull for testing purpose
Interface required by any filesystem manager
Make us able to use a java Hadoop Iterator as a scala Iterator Making us able to use filter, map ...
Make us able to use a java Hadoop Iterator as a scala Iterator Making us able to use filter, map ...
the java Hadoop Iterator
the augmented iterator