activity

Type Members

1. case class CopyActivity extends PipelineActivity with Product with Serializable

   The activity that copies data from one data node to the other.

2. trait EmrActivity extends PipelineActivity

   The base trait for activities that run on an Amazon EMR cluster

3. trait FailureAndRerunMode extends AnyRef

4. case class HadoopActivity extends EmrActivity with Product with Serializable

   Runs a MapReduce job on a cluster.

5. case class HiveActivity extends PipelineActivity with Product with Serializable

   Runs a Hive query on an Amazon EMR cluster.

6. case class HiveCopyActivity extends PipelineActivity with Product with Serializable

   Runs a Hive query on an Amazon EMR cluster.

7. case class JarActivity extends PipelineActivity with Product with Serializable

   Shell command activity that runs a given Jar

8. class MainClass extends AnyRef

9. case class MapReduceActivity extends EmrActivity with Product with Serializable

   Runs map reduce steps on an Amazon EMR cluster

10. case class MapReduceStep extends Product with Serializable

    A MapReduce step that runs on MapReduce Cluster

11. case class PigActivity extends PipelineActivity with Product with Serializable

    PigActivity provides native support for Pig scripts in AWS Data Pipeline without the requirement to use ShellCommandActivity or EmrActivity.

12. trait PipelineActivity extends PipelineObject

    The activity trait.

13. case class RedshiftCopyActivity extends PipelineActivity with Product with Serializable

    Copies data directly from DynamoDB or Amazon S3 to Amazon Redshift.

14. trait RedshiftCopyOption extends AnyRef

15. trait RedshiftUnloadOption extends AnyRef

16. trait RunnableObject extends AnyRef

    Run time references of runnable objects

17. sealed trait Script extends AnyRef

18. sealed case class ScriptContent(content: Option[String]) extends Script with Product with Serializable

19. sealed case class ScriptUri(uri: Option[S3Uri]) extends Script with Product with Serializable

20. case class ShellCommandActivity extends PipelineActivity with Product with Serializable

    Runs a command or script

21. case class ShellScriptConfig(id: PipelineObjectId, scriptUri: Parameter[S3Uri], scriptArguments: Seq[String]) extends PipelineObject with Product with Serializable

22. case class SparkActivity extends EmrActivity with Product with Serializable

    Runs spark steps on given spark cluster with Amazon EMR

23. case class SparkStep extends Product with Serializable

    A spark step that runs on Spark Cluster

24. case class SqlActivity extends PipelineActivity with Product with Serializable

    Runs an SQL query on a RedShift cluster.