AdpHiveActivity

ref: http://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/dp-object-hiveactivity.html

hiveScript: The Hive script to run.
scriptUri: The location of the Hive script to run. For example, s3://script location.
scriptVariable: Specifies script variables for Amazon EMR to pass to Hive while running a script. For example, the following example script variables would pass a SAMPLE and FILTER_DATE variable to Hive: SAMPLE=s3://elasticmapreduce/samples/hive-ads and FILTER_DATE=#{format(@scheduledStartTime,'YYYY-MM-dd')}% This field accepts multiple values and works with both script and scriptUri fields. In addition, scriptVariable functions regardless of stage set to true or false. This field is especially useful to send dynamic values to Hive using AWS Data Pipeline expressions and functions. For more information, see Pipeline Expressions and Functions.
input: The input data source. Data node object reference Yes
output: The location for the output. Data node object reference Yes
stage: Determines whether staging is enabled. Not permitted with Hive 11, so use an Amazon EMR AMI version 3.2.0 or greater.
runsOn: The Amazon EMR cluster to run this activity. EmrCluster object reference Yes

Source: AdpActivities.scala

Linear Supertypes

Serializable, Serializable, Product, Equals, AdpActivity, AdpDataPipelineObject, AdpDataPipelineAbstractObject, AdpObject, AnyRef, Any

Instance Constructors

new AdpHiveActivity(id: String, name: Option[String], hiveScript: Option[String], scriptUri: Option[String], scriptVariable: Option[String], input: AdpRef[AdpDataNode], output: AdpRef[AdpDataNode], stage: String, runsOn: AdpRef[AdpEmrCluster], dependsOn: Option[Seq[AdpRef[AdpActivity]]], precondition: Option[Seq[AdpRef[AdpPrecondition]]], onFail: Option[Seq[AdpRef[AdpSnsAlarm]]], onSuccess: Option[Seq[AdpRef[AdpSnsAlarm]]], onLateAction: Option[Seq[AdpRef[AdpSnsAlarm]]])

hiveScript
The Hive script to run.
scriptUri
The location of the Hive script to run. For example, s3://script location.
scriptVariable
Specifies script variables for Amazon EMR to pass to Hive while running a script. For example, the following example script variables would pass a SAMPLE and FILTER_DATE variable to Hive: SAMPLE=s3://elasticmapreduce/samples/hive-ads and FILTER_DATE=#{format(@scheduledStartTime,'YYYY-MM-dd')}% This field accepts multiple values and works with both script and scriptUri fields. In addition, scriptVariable functions regardless of stage set to true or false. This field is especially useful to send dynamic values to Hive using AWS Data Pipeline expressions and functions. For more information, see Pipeline Expressions and Functions.
input
The input data source. Data node object reference Yes
output
The location for the output. Data node object reference Yes
stage
Determines whether staging is enabled. Not permitted with Hive 11, so use an Amazon EMR AMI version 3.2.0 or greater.
runsOn
The Amazon EMR cluster to run this activity. EmrCluster object reference Yes

Value Members

final def !=(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def !=(arg0: Any): Boolean

Definition Classes
Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def ==(arg0: Any): Boolean

Definition Classes
Any
final def asInstanceOf[T0]: T0

Definition Classes
Any
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
val dependsOn: Option[Seq[AdpRef[AdpActivity]]]

One or more references to other Activities that must reach the FINISHED state before this activity will start.
One or more references to other Activities that must reach the FINISHED state before this activity will start.

Definition Classes
AdpHiveActivity → AdpActivity
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
val hiveScript: Option[String]

The Hive script to run.
val id: String

The ID of the object, IDs must be unique within a pipeline definition
The ID of the object, IDs must be unique within a pipeline definition

Definition Classes
AdpHiveActivity → AdpDataPipelineObject → AdpDataPipelineAbstractObject
val input: AdpRef[AdpDataNode]

The input data source.
The input data source. Data node object reference Yes
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
val name: Option[String]

The optional, user-defined label of the object.
The optional, user-defined label of the object. If you do not provide a name for an object in a pipeline definition, AWS Data Pipeline automatically duplicates the value of id.

Definition Classes
AdpHiveActivity → AdpDataPipelineObject → AdpDataPipelineAbstractObject
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
val onFail: Option[Seq[AdpRef[AdpSnsAlarm]]]

The SNS alarm to raise when the activity fails.
The SNS alarm to raise when the activity fails.

Definition Classes
AdpHiveActivity → AdpActivity
val onLateAction: Option[Seq[AdpRef[AdpSnsAlarm]]]

The SNS alarm to raise when the activity fails to start on time.
The SNS alarm to raise when the activity fails to start on time.

Definition Classes
AdpHiveActivity → AdpActivity
val onSuccess: Option[Seq[AdpRef[AdpSnsAlarm]]]

The SNS alarm to raise when the activity succeeds.
The SNS alarm to raise when the activity succeeds.

Definition Classes
AdpHiveActivity → AdpActivity
val output: AdpRef[AdpDataNode]

The location for the output.
The location for the output. Data node object reference Yes
val precondition: Option[Seq[AdpRef[AdpPrecondition]]]

A condition that must be met before the object can run.
A condition that must be met before the object can run. To specify multiple conditions, add multiple precondition fields. The activity cannot run until all its conditions are met.

Definition Classes
AdpHiveActivity → AdpActivity
val runsOn: AdpRef[AdpEmrCluster]

The Amazon EMR cluster to run this activity.
The Amazon EMR cluster to run this activity. EmrCluster object reference Yes

Definition Classes
AdpHiveActivity → AdpActivity
val scriptUri: Option[String]

The location of the Hive script to run.
The location of the Hive script to run. For example, s3://script location.
val scriptVariable: Option[String]

Specifies script variables for Amazon EMR to pass to Hive while running a script.
Specifies script variables for Amazon EMR to pass to Hive while running a script. For example, the following example script variables would pass a SAMPLE and FILTER_DATE variable to Hive: SAMPLE=s3://elasticmapreduce/samples/hive-ads and FILTER_DATE=#{format(@scheduledStartTime,'YYYY-MM-dd')}% This field accepts multiple values and works with both script and scriptUri fields. In addition, scriptVariable functions regardless of stage set to true or false. This field is especially useful to send dynamic values to Hive using AWS Data Pipeline expressions and functions. For more information, see Pipeline Expressions and Functions.
val stage: String

Determines whether staging is enabled.
Determines whether staging is enabled. Not permitted with Hive 11, so use an Amazon EMR AMI version 3.2.0 or greater.
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
val type: String

The type of object.
The type of object. Use one of the predefined AWS Data Pipeline object types.

Definition Classes
AdpHiveActivity → AdpDataPipelineObject
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

Instance Constructors

Value Members

final def !=(arg0: AnyRef): Boolean

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: AnyRef): Boolean

final def ==(arg0: Any): Boolean

final def asInstanceOf[T0]: T0

def clone(): AnyRef

val dependsOn: Option[Seq[AdpRef[AdpActivity]]]

final def eq(arg0: AnyRef): Boolean

def finalize(): Unit

final def getClass(): Class[_]

val hiveScript: Option[String]

val id: String

val input: AdpRef[AdpDataNode]

final def isInstanceOf[T0]: Boolean

val name: Option[String]

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

val onFail: Option[Seq[AdpRef[AdpSnsAlarm]]]

val onLateAction: Option[Seq[AdpRef[AdpSnsAlarm]]]

val onSuccess: Option[Seq[AdpRef[AdpSnsAlarm]]]

val output: AdpRef[AdpDataNode]

val precondition: Option[Seq[AdpRef[AdpPrecondition]]]

val runsOn: AdpRef[AdpEmrCluster]

val scriptUri: Option[String]

val scriptVariable: Option[String]

val stage: String

final def synchronized[T0](arg0: ⇒ T0): T0

val type: String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AdpActivity

Inherited from AdpDataPipelineObject

Inherited from AdpDataPipelineAbstractObject

Inherited from AdpObject

Inherited from AnyRef

Inherited from Any

Ungrouped