activity

Type Members

1. case class CopyActivity extends PipelineActivity with Product with Serializable

   The activity that copies data from one data node to the other.

2. case class DeleteS3PathActivity extends PipelineActivity with Product with Serializable

   Activity to recursively delete files in an S3 path.

3. case class EmailFileActivity extends PipelineActivity with Product with Serializable

4. trait EmrActivity extends PipelineActivity

   The base trait for activities that run on an Amazon EMR cluster

5. trait GoogleStorageActivity extends PipelineActivity

6. case class GoogleStorageDownloadActivity extends GoogleStorageActivity with Product with Serializable

   Google Storage Download activity

7. case class GoogleStorageUploadActivity extends GoogleStorageActivity with Product with Serializable

   Google Storage Upload activity

8. case class HiveActivity extends PipelineActivity with Product with Serializable

   Runs a Hive query on an Amazon EMR cluster.

9. case class HiveCopyActivity extends PipelineActivity with Product with Serializable

   Runs a Hive query on an Amazon EMR cluster.

10. case class JarActivity extends PipelineActivity with Product with Serializable

    Shell command activity that runs a given Jar

11. case class MapReduceActivity extends EmrActivity with Product with Serializable

    Runs map reduce steps on an Amazon EMR cluster

12. case class MapReduceStep extends Product with Serializable

    A MapReduce step that runs on MapReduce Cluster

13. case class MergeFilesActivity extends PipelineActivity with Product with Serializable

14. case class PigActivity extends PipelineActivity with Product with Serializable

    PigActivity provides native support for Pig scripts in AWS Data Pipeline without the requirement to use ShellCommandActivity or EmrActivity.

15. trait PipelineActivity extends PipelineObject

    The activity trait.

16. case class PythonActivity extends PipelineActivity with Product with Serializable

    Shell command activity that runs a given python script

17. case class RedshiftCopyActivity extends PipelineActivity with Product with Serializable

    Copies data directly from DynamoDB or Amazon S3 to Amazon Redshift.

18. trait RedshiftCopyOption extends AnyRef

19. case class RedshiftUnloadActivity extends PipelineActivity with Product with Serializable

    Unload result of the given sql script from redshift to given s3Path.

20. trait RedshiftUnloadOption extends AnyRef

21. trait RunnableObject extends AnyRef

    Run time references of runnable objects

22. class S3DistCpActivity extends EmrActivity

23. case class ShellCommandActivity extends PipelineActivity with Product with Serializable

    Runs a command or script

24. case class SparkActivity extends EmrActivity with Product with Serializable

    Runs spark steps on given spark cluster with Amazon EMR

25. case class SparkStep extends Product with Serializable

    A spark step that runs on Spark Cluster

26. case class SqlActivity extends PipelineActivity with Product with Serializable

    Runs an SQL query on a RedShift cluster.