The Hive script to run.
The location of the Hive script to run. For example, s3://script location.
Specifies script variables for Amazon EMR to pass to Hive while running a script. For example, the following example script variables would pass a SAMPLE and FILTER_DATE variable to Hive: SAMPLE=s3://elasticmapreduce/samples/hive-ads and FILTER_DATE=#{format(@scheduledStartTime,'YYYY-MM-dd')}% This field accepts multiple values and works with both script and scriptUri fields. In addition, scriptVariable functions regardless of stage set to true or false. This field is especially useful to send dynamic values to Hive using AWS Data Pipeline expressions and functions. For more information, see Pipeline Expressions and Functions.
The input data source. Data node object reference Yes
The location for the output. Data node object reference Yes
Determines whether staging is enabled. Not permitted with Hive 11, so use an Amazon EMR AMI version 3.2.0 or greater.
The Amazon EMR cluster to run this activity. EmrCluster object reference Yes
One or more references to other Activities that must reach the FINISHED state before this activity will start.
One or more references to other Activities that must reach the FINISHED state before this activity will start.
The Hive script to run.
The ID of the object, IDs must be unique within a pipeline definition
The ID of the object, IDs must be unique within a pipeline definition
The input data source.
The input data source. Data node object reference Yes
The optional, user-defined label of the object.
The optional, user-defined label of the object. If you do not provide a name for an object in a pipeline definition, AWS Data Pipeline automatically duplicates the value of id.
The SNS alarm to raise when the activity fails.
The SNS alarm to raise when the activity fails.
The SNS alarm to raise when the activity fails to start on time.
The SNS alarm to raise when the activity fails to start on time.
The SNS alarm to raise when the activity succeeds.
The SNS alarm to raise when the activity succeeds.
The location for the output.
The location for the output. Data node object reference Yes
A condition that must be met before the object can run.
A condition that must be met before the object can run. To specify multiple conditions, add multiple precondition fields. The activity cannot run until all its conditions are met.
The Amazon EMR cluster to run this activity.
The Amazon EMR cluster to run this activity. EmrCluster object reference Yes
The location of the Hive script to run.
The location of the Hive script to run. For example, s3://script location.
Specifies script variables for Amazon EMR to pass to Hive while running a script.
Specifies script variables for Amazon EMR to pass to Hive while running a script. For example, the following example script variables would pass a SAMPLE and FILTER_DATE variable to Hive: SAMPLE=s3://elasticmapreduce/samples/hive-ads and FILTER_DATE=#{format(@scheduledStartTime,'YYYY-MM-dd')}% This field accepts multiple values and works with both script and scriptUri fields. In addition, scriptVariable functions regardless of stage set to true or false. This field is especially useful to send dynamic values to Hive using AWS Data Pipeline expressions and functions. For more information, see Pipeline Expressions and Functions.
Determines whether staging is enabled.
Determines whether staging is enabled. Not permitted with Hive 11, so use an Amazon EMR AMI version 3.2.0 or greater.
The type of object.
The type of object. Use one of the predefined AWS Data Pipeline object types.
ref: http://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/dp-object-hiveactivity.html
The Hive script to run.
The location of the Hive script to run. For example, s3://script location.
Specifies script variables for Amazon EMR to pass to Hive while running a script. For example, the following example script variables would pass a SAMPLE and FILTER_DATE variable to Hive: SAMPLE=s3://elasticmapreduce/samples/hive-ads and FILTER_DATE=#{format(@scheduledStartTime,'YYYY-MM-dd')}% This field accepts multiple values and works with both script and scriptUri fields. In addition, scriptVariable functions regardless of stage set to true or false. This field is especially useful to send dynamic values to Hive using AWS Data Pipeline expressions and functions. For more information, see Pipeline Expressions and Functions.
The input data source. Data node object reference Yes
The location for the output. Data node object reference Yes
Determines whether staging is enabled. Not permitted with Hive 11, so use an Amazon EMR AMI version 3.2.0 or greater.
The Amazon EMR cluster to run this activity. EmrCluster object reference Yes