com.krux.hyperion.aws

AdpRedshiftCopyActivity

case class AdpRedshiftCopyActivity(id: String, name: Option[String], insertMode: String, transformSql: Option[String], queue: Option[String], commandOptions: Option[Seq[String]], input: AdpRef[AdpDataNode], output: AdpRef[AdpDataNode], workerGroup: Option[String], runsOn: Option[AdpRef[AdpEc2Resource]], dependsOn: Option[Seq[AdpRef[AdpActivity]]], precondition: Option[Seq[AdpRef[AdpPrecondition]]], onFail: Option[Seq[AdpRef[AdpSnsAlarm]]], onSuccess: Option[Seq[AdpRef[AdpSnsAlarm]]], onLateAction: Option[Seq[AdpRef[AdpSnsAlarm]]], attemptTimeout: Option[String], lateAfterTimeout: Option[String], maximumRetries: Option[String], retryDelay: Option[String], failureAndRerunMode: Option[String]) extends AdpDataPipelineAbstractObject with AdpActivity with Product with Serializable

ref: http://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/dp-object-redshiftcopyactivity.html

id

required for AdpDataPipelineObject

name

required for AdpDataPipelineObject

insertMode

Determines what AWS Data Pipeline does with pre-existing data in the target table that overlaps with rows in the data to be loaded. Valid values are KEEP_EXISTING, OVERWRITE_EXISTING, and TRUNCATE.

transformSql

The SQL SELECT expression used to transform the input data.

queue

Corresponds to the query_group setting in Amazon Redshift, which allows you to assign and prioritize concurrent activities based on their placement in queues. Amazon Redshift limits the number of simultaneous connections to 15.

commandOptions

Takes COPY parameters to pass to the Amazon Redshift data node.

input

The input data node. The data source can be Amazon S3, DynamoDB, or Amazon Redshift.

output

The output data node. The output location can be Amazon S3 or Amazon Redshift.

runsOn

Required for AdpActivity

dependsOn

Required for AdpActivity

Source
AdpActivities.scala
Linear Supertypes
Serializable, Serializable, Product, Equals, AdpActivity, AdpDataPipelineObject, AdpDataPipelineAbstractObject, AdpObject, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. AdpRedshiftCopyActivity
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. AdpActivity
  7. AdpDataPipelineObject
  8. AdpDataPipelineAbstractObject
  9. AdpObject
  10. AnyRef
  11. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new AdpRedshiftCopyActivity(id: String, name: Option[String], insertMode: String, transformSql: Option[String], queue: Option[String], commandOptions: Option[Seq[String]], input: AdpRef[AdpDataNode], output: AdpRef[AdpDataNode], workerGroup: Option[String], runsOn: Option[AdpRef[AdpEc2Resource]], dependsOn: Option[Seq[AdpRef[AdpActivity]]], precondition: Option[Seq[AdpRef[AdpPrecondition]]], onFail: Option[Seq[AdpRef[AdpSnsAlarm]]], onSuccess: Option[Seq[AdpRef[AdpSnsAlarm]]], onLateAction: Option[Seq[AdpRef[AdpSnsAlarm]]], attemptTimeout: Option[String], lateAfterTimeout: Option[String], maximumRetries: Option[String], retryDelay: Option[String], failureAndRerunMode: Option[String])

    id

    required for AdpDataPipelineObject

    name

    required for AdpDataPipelineObject

    insertMode

    Determines what AWS Data Pipeline does with pre-existing data in the target table that overlaps with rows in the data to be loaded. Valid values are KEEP_EXISTING, OVERWRITE_EXISTING, and TRUNCATE.

    transformSql

    The SQL SELECT expression used to transform the input data.

    queue

    Corresponds to the query_group setting in Amazon Redshift, which allows you to assign and prioritize concurrent activities based on their placement in queues. Amazon Redshift limits the number of simultaneous connections to 15.

    commandOptions

    Takes COPY parameters to pass to the Amazon Redshift data node.

    input

    The input data node. The data source can be Amazon S3, DynamoDB, or Amazon Redshift.

    output

    The output data node. The output location can be Amazon S3 or Amazon Redshift.

    runsOn

    Required for AdpActivity

    dependsOn

    Required for AdpActivity

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. val attemptTimeout: Option[String]

    The timeout time interval for an object attempt.

    The timeout time interval for an object attempt. If an attempt does not complete within the start time plus this time interval, AWS Data Pipeline marks the attempt as failed and your retry settings determine the next steps taken.

    Definition Classes
    AdpRedshiftCopyActivityAdpActivity
  8. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. val commandOptions: Option[Seq[String]]

    Takes COPY parameters to pass to the Amazon Redshift data node.

  10. val dependsOn: Option[Seq[AdpRef[AdpActivity]]]

    Required for AdpActivity

    Required for AdpActivity

    Definition Classes
    AdpRedshiftCopyActivityAdpActivity
  11. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  12. val failureAndRerunMode: Option[String]

    Determines whether pipeline object failures and rerun commands cascade through pipeline object dependencies

    Determines whether pipeline object failures and rerun commands cascade through pipeline object dependencies

    Possible values include cascade and none.

    Definition Classes
    AdpRedshiftCopyActivityAdpActivity
  13. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  14. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  15. val id: String

    required for AdpDataPipelineObject

    required for AdpDataPipelineObject

    Definition Classes
    AdpRedshiftCopyActivityAdpDataPipelineObjectAdpObject
  16. val input: AdpRef[AdpDataNode]

    The input data node.

    The input data node. The data source can be Amazon S3, DynamoDB, or Amazon Redshift.

  17. val insertMode: String

    Determines what AWS Data Pipeline does with pre-existing data in the target table that overlaps with rows in the data to be loaded.

    Determines what AWS Data Pipeline does with pre-existing data in the target table that overlaps with rows in the data to be loaded. Valid values are KEEP_EXISTING, OVERWRITE_EXISTING, and TRUNCATE.

  18. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  19. val lateAfterTimeout: Option[String]

    The time period in which the object run must start.

    The time period in which the object run must start. If the object does not start within the scheduled start time plus this time interval, it is considered late

    Definition Classes
    AdpRedshiftCopyActivityAdpActivity
  20. val maximumRetries: Option[String]

    The maximum number of times to retry the action.

    The maximum number of times to retry the action. The default value is 2, which results in 3 tries total (1 original attempt plus 2 retries). The maximum value is 5 (6 total attempts).

    Definition Classes
    AdpRedshiftCopyActivityAdpActivity
  21. val name: Option[String]

    required for AdpDataPipelineObject

    required for AdpDataPipelineObject

    Definition Classes
    AdpRedshiftCopyActivityAdpDataPipelineObjectAdpDataPipelineAbstractObject
  22. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  23. final def notify(): Unit

    Definition Classes
    AnyRef
  24. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  25. val onFail: Option[Seq[AdpRef[AdpSnsAlarm]]]

    The SNS alarm to raise when the activity fails.

    The SNS alarm to raise when the activity fails.

    Definition Classes
    AdpRedshiftCopyActivityAdpActivity
  26. val onLateAction: Option[Seq[AdpRef[AdpSnsAlarm]]]

    The SNS alarm to raise when the activity fails to start on time.

    The SNS alarm to raise when the activity fails to start on time.

    Definition Classes
    AdpRedshiftCopyActivityAdpActivity
  27. val onSuccess: Option[Seq[AdpRef[AdpSnsAlarm]]]

    The SNS alarm to raise when the activity succeeds.

    The SNS alarm to raise when the activity succeeds.

    Definition Classes
    AdpRedshiftCopyActivityAdpActivity
  28. val output: AdpRef[AdpDataNode]

    The output data node.

    The output data node. The output location can be Amazon S3 or Amazon Redshift.

  29. val precondition: Option[Seq[AdpRef[AdpPrecondition]]]

    A condition that must be met before the object can run.

    A condition that must be met before the object can run. To specify multiple conditions, add multiple precondition fields. The activity cannot run until all its conditions are met.

    Definition Classes
    AdpRedshiftCopyActivityAdpActivity
  30. val queue: Option[String]

    Corresponds to the query_group setting in Amazon Redshift, which allows you to assign and prioritize concurrent activities based on their placement in queues.

    Corresponds to the query_group setting in Amazon Redshift, which allows you to assign and prioritize concurrent activities based on their placement in queues. Amazon Redshift limits the number of simultaneous connections to 15.

  31. val retryDelay: Option[String]

    The timeout duration between two retry attempts.

    The timeout duration between two retry attempts. The default is 10 minutes.

    Definition Classes
    AdpRedshiftCopyActivityAdpActivity
  32. val runsOn: Option[AdpRef[AdpEc2Resource]]

    Required for AdpActivity

  33. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  34. val transformSql: Option[String]

    The SQL SELECT expression used to transform the input data.

  35. val type: String

    The type of object.

    The type of object. Use one of the predefined AWS Data Pipeline object types.

    Definition Classes
    AdpRedshiftCopyActivityAdpDataPipelineObject
  36. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  37. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  38. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  39. val workerGroup: Option[String]

    The worker group.

    The worker group. This is used for routing tasks. If you provide a runsOn value and workerGroup exists, workerGroup is ignored.

    Definition Classes
    AdpRedshiftCopyActivityAdpActivity

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AdpActivity

Inherited from AdpDataPipelineObject

Inherited from AdpObject

Inherited from AnyRef

Inherited from Any

Ungrouped