required for AdpDataPipelineObject
required for AdpDataPipelineObject
The input data node. The data source can be Amazon S3, DynamoDB, or Amazon Redshift.
Determines what AWS Data Pipeline does with pre-existing data in the target table that overlaps with rows in the data to be loaded. Valid values are KEEP_EXISTING, OVERWRITE_EXISTING, and TRUNCATE.
The output data node. The output location can be Amazon S3 or Amazon Redshift.
The SQL SELECT expression used to transform the input data.
Takes COPY parameters to pass to the Amazon Redshift data node.
Corresponds to the query_group setting in Amazon Redshift, which allows you to assign and prioritize concurrent activities based on their placement in queues. Amazon Redshift limits the number of simultaneous connections to 15.
Required for AdpActivity
Required for AdpActivity
Takes COPY parameters to pass to the Amazon Redshift data node.
Required for AdpActivity
Required for AdpActivity
required for AdpDataPipelineObject
required for AdpDataPipelineObject
The input data node.
The input data node. The data source can be Amazon S3, DynamoDB, or Amazon Redshift.
Determines what AWS Data Pipeline does with pre-existing data in the target table that overlaps with rows in the data to be loaded.
Determines what AWS Data Pipeline does with pre-existing data in the target table that overlaps with rows in the data to be loaded. Valid values are KEEP_EXISTING, OVERWRITE_EXISTING, and TRUNCATE.
required for AdpDataPipelineObject
required for AdpDataPipelineObject
The SNS alarm to raise when the activity fails.
The SNS alarm to raise when the activity fails.
The SNS alarm to raise when the activity fails to start on time.
The SNS alarm to raise when the activity fails to start on time.
The SNS alarm to raise when the activity succeeds.
The SNS alarm to raise when the activity succeeds.
The output data node.
The output data node. The output location can be Amazon S3 or Amazon Redshift.
A condition that must be met before the object can run.
A condition that must be met before the object can run. To specify multiple conditions, add multiple precondition fields. The activity cannot run until all its conditions are met.
Corresponds to the query_group setting in Amazon Redshift, which allows you to assign and prioritize concurrent activities based on their placement in queues.
Corresponds to the query_group setting in Amazon Redshift, which allows you to assign and prioritize concurrent activities based on their placement in queues. Amazon Redshift limits the number of simultaneous connections to 15.
Required for AdpActivity
Required for AdpActivity
The SQL SELECT expression used to transform the input data.
The type of object.
The type of object. Use one of the predefined AWS Data Pipeline object types.
ref: http://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/dp-object-redshiftcopyactivity.html
required for AdpDataPipelineObject
required for AdpDataPipelineObject
The input data node. The data source can be Amazon S3, DynamoDB, or Amazon Redshift.
Determines what AWS Data Pipeline does with pre-existing data in the target table that overlaps with rows in the data to be loaded. Valid values are KEEP_EXISTING, OVERWRITE_EXISTING, and TRUNCATE.
The output data node. The output location can be Amazon S3 or Amazon Redshift.
The SQL SELECT expression used to transform the input data.
Takes COPY parameters to pass to the Amazon Redshift data node.
Corresponds to the query_group setting in Amazon Redshift, which allows you to assign and prioritize concurrent activities based on their placement in queues. Amazon Redshift limits the number of simultaneous connections to 15.
Required for AdpActivity
Required for AdpActivity