datanode

Type Members

1. trait Copyable extends DataNode

   

   The data node that can be used as input and output in CopyActivity

2. trait DataNode extends PipelineObject

   

   The base trait of all data nodes

3. case class InsertTableQuery(table: String, columns: List[String]) extends TableQuery with Product with Serializable

   
   Note

   this is not tested or documented anywhere in AWS Data Pipeline Docs, we are assuming the insert syntax is 'insert into mytable (col1, col2, ...)' without 'values'.

4. case class RedshiftDataNode extends DataNode with Product with Serializable

   

   The abstracted RedshiftDataNode

5. sealed trait S3DataNode extends Copyable

   

6. case class S3File extends S3DataNode with Product with Serializable

   

   Defines data from s3

7. case class S3Folder extends S3DataNode with Product with Serializable

   

   Defines data from s3 directory

8. case class SelectTableQuery(table: String, columns: List[String], whereClause: Option[String]) extends TableQuery with Product with Serializable

   

9. case class SqlDataNode(id: PipelineObjectId, tableQuery: TableQuery, database: Database, preconditions: Seq[Precondition], onSuccessAlarms: Seq[SnsAlarm], onFailAlarms: Seq[SnsAlarm]) extends Copyable with Product with Serializable

   
   Note

   that the AWS Datapipeline SqlDataNode does not require a JdbcDatabase parameter, but requires specify the username, password, etc. within the object, we require a JdbcDatabase object for consistency with other database data node objects.

10. sealed trait TableQuery extends AnyRef