activity

Type Members

1. case class CopyActivity extends PipelineActivity with Product with Serializable

   The activity that copies data from one data node to the other.

2. case class DeleteS3PathActivity extends PipelineActivity with Product with Serializable

   Activity to recursively delete files in an S3 path.

3. trait EmrActivity extends PipelineActivity

   The base trait for activities that run on an Amazon EMR cluster

4. trait GoogleStorageActivity extends PipelineActivity

5. case class GoogleStorageDownloadActivity extends GoogleStorageActivity with Product with Serializable

   Google Storage Download activity

6. case class GoogleStorageUploadActivity extends GoogleStorageActivity with Product with Serializable

   Google Storage Upload activity

7. case class HiveActivity extends PipelineActivity with Product with Serializable

   Runs a Hive query on an Amazon EMR cluster.

8. case class HiveCopyActivity extends PipelineActivity with Product with Serializable

   Runs a Hive query on an Amazon EMR cluster.

9. case class JarActivity extends PipelineActivity with Product with Serializable

   Shell command activity that runs a given Jar

10. case class MapReduceActivity extends EmrActivity with Product with Serializable

    Runs map reduce steps on an Amazon EMR cluster

11. case class MapReduceStep(jar: String = "", mainClass: String = "", args: Seq[String] = ...) extends Product with Serializable

    A MapReduce step that runs on MapReduce Cluster

12. case class PigActivity extends PipelineActivity with Product with Serializable

    PigActivity provides native support for Pig scripts in AWS Data Pipeline without the requirement to use ShellCommandActivity or EmrActivity.

13. trait PipelineActivity extends PipelineObject

    The activity trait.

14. case class RedshiftCopyActivity extends PipelineActivity with Product with Serializable

    Copies data directly from DynamoDB or Amazon S3 to Amazon Redshift.

15. trait RedshiftCopyOption extends AnyRef

16. case class RedshiftUnloadActivity extends PipelineActivity with Product with Serializable

    Unload result of the given sql script from redshift to given s3Path.

17. trait RedshiftUnloadOption extends AnyRef

18. trait RunnableObject extends AnyRef

    Run time references of runnable objects

19. class S3DistCpActivity extends EmrActivity

20. case class ShellCommandActivity extends PipelineActivity with Product with Serializable

    Runs a command or script

21. case class SparkActivity extends EmrActivity with Product with Serializable

    Runs spark steps on given spark cluster with Amazon EMR

22. case class SparkStep(jar: String = "", mainClass: String = "", args: Seq[String] = ...)(implicit hc: HyperionContext) extends Product with Serializable

    A spark step that runs on Spark Cluster

23. case class SqlActivity extends PipelineActivity with Product with Serializable

    Runs an SQL query on a RedShift cluster.