com.krux.hyperion.objects

CopyActivity

case class CopyActivity extends PipelineActivity with Product with Serializable

The activity that copys data from one data node to the other.

Source
CopyActivity.scala
Note

it seems that both input and output format needs to be in CsvDataFormat for this copy to work properly and it needs to be a specific variance of the CSV, for more information check the web page:

http://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/dp-object-copyactivity.html

From our experience it's really hard to export using TsvDataFormat, in both import and export especially for tasks involving RedshiftCopyActivity. A general rule of thumb is always use default CsvDataFormat for tasks involving both exporting to S3 and copy to redshift.

Linear Supertypes
Serializable, Serializable, Product, Equals, PipelineActivity, PipelineObject, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. CopyActivity
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. PipelineActivity
  7. PipelineObject
  8. AnyRef
  9. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. def dependsOn(activities: PipelineActivity*): CopyActivity

    Definition Classes
    CopyActivity → PipelineActivity

  9. val dependsOn: Seq[PipelineActivity]

  10. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  11. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  12. def forClient(client: String): CopyActivity

  13. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  14. implicit val hc: HyperionContext

  15. val id: String

    Definition Classes
    CopyActivity → PipelineObject

  16. val input: Copyable

  17. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  18. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  19. final def notify(): Unit

    Definition Classes
    AnyRef

  20. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  21. def objects: Iterable[PipelineObject]

    Definition Classes
    CopyActivity → PipelineObject

  22. def onFail(alarms: SnsAlarm*): CopyActivity

    Definition Classes
    CopyActivity → PipelineActivity

  23. val onFailAlarms: Seq[SnsAlarm]

  24. def onLateAction(alarms: SnsAlarm*): CopyActivity

    Definition Classes
    CopyActivity → PipelineActivity

  25. val onLateActionAlarms: Seq[SnsAlarm]

  26. def onSuccess(alarms: SnsAlarm*): CopyActivity

    Definition Classes
    CopyActivity → PipelineActivity

  27. val onSuccessAlarms: Seq[SnsAlarm]

  28. val output: Copyable

  29. val preconditions: Seq[Precondition]

  30. val runsOn: Ec2Resource

  31. def serialize: AdpCopyActivity

    Definition Classes
    CopyActivity → PipelineObject

  32. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  33. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  34. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  35. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  36. def whenMet(preconditions: Precondition*): CopyActivity

    Definition Classes
    CopyActivity → PipelineActivity

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from PipelineActivity

Inherited from PipelineObject

Inherited from AnyRef

Inherited from Any

Ungrouped