activity

Type Members

1. case class ActivityFields[A <: ResourceObject](runsOn: Resource[A], dependsOn: Seq[PipelineActivity[_]] = collection.this.Seq.empty[Nothing], preconditions: Seq[Precondition] = collection.this.Seq.empty[Nothing], onFailAlarms: Seq[SnsAlarm] = collection.this.Seq.empty[Nothing], onSuccessAlarms: Seq[SnsAlarm] = collection.this.Seq.empty[Nothing], onLateActionAlarms: Seq[SnsAlarm] = collection.this.Seq.empty[Nothing], maximumRetries: Option[HInt] = scala.None, attemptTimeout: Option[HDuration] = scala.None, lateAfterTimeout: Option[HDuration] = scala.None, retryDelay: Option[HDuration] = scala.None, failureAndRerunMode: Option[FailureAndRerunMode] = scala.None, maxActiveInstances: Option[HInt] = scala.None) extends Product with Serializable

2. trait BaseShellCommandActivity extends PipelineActivity[Ec2Resource]

3. case class CopyActivity extends PipelineActivity[Ec2Resource] with Product with Serializable

   The activity that copies data from one data node to the other.

4. trait EmrActivity[A <: EmrCluster] extends PipelineActivity[A]

   The base trait for activities that run on an Amazon EMR cluster

5. trait EmrTaskActivity[A <: EmrCluster] extends EmrActivity[A]

6. case class EmrTaskActivityFields(preActivityTaskConfig: Option[ShellScriptConfig] = scala.None, postActivityTaskConfig: Option[ShellScriptConfig] = scala.None) extends Product with Serializable

7. trait FailureAndRerunMode extends AnyRef

8. case class HadoopActivity[A <: EmrCluster] extends EmrTaskActivity[A] with Product with Serializable

   Runs a MapReduce job on a cluster.

9. case class HiveActivity[A <: EmrCluster] extends EmrTaskActivity[A] with Product with Serializable

   Runs a Hive query on an Amazon EMR cluster.

10. case class HiveCopyActivity[A <: EmrCluster] extends EmrTaskActivity[A] with Product with Serializable

    Runs a Hive query on an Amazon EMR cluster.

11. case class JarActivity extends BaseShellCommandActivity with WithS3Input with WithS3Output with Product with Serializable

    Shell command activity that runs a given Jar

12. class MainClass extends AnyRef

13. case class MapReduceActivity[A <: EmrCluster] extends EmrActivity[A] with Product with Serializable

    Runs map reduce steps on an Amazon EMR cluster

14. case class MapReduceStep extends Product with Serializable

    A MapReduce step that runs on MapReduce Cluster

15. case class PigActivity[A <: EmrCluster] extends EmrTaskActivity[A] with Product with Serializable

    PigActivity provides native support for Pig scripts in AWS Data Pipeline without the requirement to use ShellCommandActivity or EmrActivity.

16. trait PipelineActivity[A <: ResourceObject] extends NamedPipelineObject

    The activity trait.

17. case class RedshiftCopyActivity extends PipelineActivity[Ec2Resource] with Product with Serializable

    Copies data directly from DynamoDB or Amazon S3 to Amazon Redshift.

18. case class RedshiftCopyOption(repr: Seq[String]) extends Product with Serializable

19. trait RedshiftUnloadOption extends AnyRef

20. sealed trait Script extends AnyRef

21. sealed case class ScriptContent(content: Option[HString]) extends Script with Product with Serializable

22. sealed case class ScriptUri(uri: Option[HS3Uri]) extends Script with Product with Serializable

23. case class ShellCommandActivity extends BaseShellCommandActivity with WithS3Input with WithS3Output with Product with Serializable

    Runs a command or script

24. case class ShellCommandActivityFields(script: Script, scriptArguments: Seq[HString] = collection.this.Seq.empty[Nothing], stdout: Option[HString] = scala.None, stderr: Option[HString] = scala.None, stage: Option[HBoolean] = scala.None, input: Seq[S3DataNode] = collection.this.Seq.empty[Nothing], output: Seq[S3DataNode] = collection.this.Seq.empty[Nothing]) extends Product with Serializable

25. case class ShellScriptConfig(baseFields: BaseFields, scriptUri: HS3Uri, scriptArguments: Seq[HString]) extends NamedPipelineObject with Product with Serializable

26. case class SparkActivity extends EmrActivity[SparkCluster] with Product with Serializable

    Runs spark steps on given spark cluster with Amazon EMR

27. case class SparkStep extends Product with Serializable

    A Spark step that runs on Spark Cluster

28. case class SparkTaskActivity extends EmrTaskActivity[SparkCluster] with Product with Serializable

    Runs a Spark job on a cluster.

29. case class SqlActivity extends PipelineActivity[Ec2Resource] with Product with Serializable

    Runs an SQL query on a RedShift cluster.

30. trait WithS3Input extends AnyRef

31. trait WithS3Output extends AnyRef