Class/Object

com.krux.hyperion.activity

MapReduceActivity

Related Docs: object MapReduceActivity | package activity

Permalink

case class MapReduceActivity[A <: EmrCluster] extends EmrActivity[A] with Product with Serializable

Runs map reduce steps on an Amazon EMR cluster

Source
MapReduceActivity.scala
Linear Supertypes
Serializable, Serializable, Product, Equals, EmrActivity[A], PipelineActivity[A], NamedPipelineObject, PipelineObject, Ordered[PipelineObject], Comparable[PipelineObject], AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. MapReduceActivity
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. EmrActivity
  7. PipelineActivity
  8. NamedPipelineObject
  9. PipelineObject
  10. Ordered
  11. Comparable
  12. AnyRef
  13. Any
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Type Members

  1. type Self = MapReduceActivity[A]

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. def <(that: PipelineObject): Boolean

    Permalink
    Definition Classes
    Ordered
  4. def <=(that: PipelineObject): Boolean

    Permalink
    Definition Classes
    Ordered
  5. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  6. def >(that: PipelineObject): Boolean

    Permalink
    Definition Classes
    Ordered
  7. def >=(that: PipelineObject): Boolean

    Permalink
    Definition Classes
    Ordered
  8. val activityFields: ActivityFields[A]

    Permalink
    Definition Classes
    MapReduceActivityPipelineActivity
  9. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  10. def attemptTimeout: Option[HDuration]

    Permalink
    Definition Classes
    PipelineActivity
  11. val baseFields: BaseFields

    Permalink
    Definition Classes
    MapReduceActivityNamedPipelineObject
  12. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  13. def compare(that: PipelineObject): Int

    Permalink
    Definition Classes
    PipelineObject → Ordered
  14. def compareTo(that: PipelineObject): Int

    Permalink
    Definition Classes
    Ordered → Comparable
  15. def dependsOn: Seq[PipelineActivity[_]]

    Permalink
    Definition Classes
    PipelineActivity
  16. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  17. def failureAndRerunMode: Option[FailureAndRerunMode]

    Permalink
    Definition Classes
    PipelineActivity
  18. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  19. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  20. def groupedBy(group: String): Self

    Permalink

    Postfix the name field

    Postfix the name field

    Definition Classes
    NamedPipelineObject
  21. def id: PipelineObjectId

    Permalink
    Definition Classes
    NamedPipelineObjectPipelineObject
  22. def idGroupedBy(group: String): Self

    Permalink

    Have a grouping postfix in the id field

    Have a grouping postfix in the id field

    Definition Classes
    NamedPipelineObject
    Note

    Id naming is more restrictive, it is recommended to not changing the id unleass you have a good reason

  23. def idNamed(namePrefix: String): Self

    Permalink

    Id field will be prefixed with name

    Id field will be prefixed with name

    Definition Classes
    NamedPipelineObject
    Note

    Id naming is more restrictive, it is recommended to not changing the id unless you have a good reason

  24. val inputs: Seq[S3DataNode]

    Permalink
  25. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  26. def lateAfterTimeout: Option[HDuration]

    Permalink
    Definition Classes
    PipelineActivity
  27. def maximumRetries: Option[HInt]

    Permalink
    Definition Classes
    PipelineActivity
  28. def name: Option[String]

    Permalink

    Name of the pipeline object, if not set, it will defaults to

    Name of the pipeline object, if not set, it will defaults to

    Option(id)
    Definition Classes
    NamedPipelineObject
  29. def named(namePrefix: String): Self

    Permalink

    Give the object a name prefix

    Give the object a name prefix

    Definition Classes
    NamedPipelineObject
  30. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  31. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  32. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  33. def objects: Iterable[PipelineObject]

    Permalink
  34. def onFail(alarms: SnsAlarm*): Self

    Permalink
    Definition Classes
    PipelineActivity
  35. def onFailAlarms: Seq[SnsAlarm]

    Permalink
    Definition Classes
    PipelineActivity
  36. def onLateAction(alarms: SnsAlarm*): Self

    Permalink
    Definition Classes
    PipelineActivity
  37. def onLateActionAlarms: Seq[SnsAlarm]

    Permalink
    Definition Classes
    PipelineActivity
  38. def onSuccess(alarms: SnsAlarm*): Self

    Permalink
    Definition Classes
    PipelineActivity
  39. def onSuccessAlarms: Seq[SnsAlarm]

    Permalink
    Definition Classes
    PipelineActivity
  40. val outputs: Seq[S3DataNode]

    Permalink
  41. val postStepCommands: Seq[HString]

    Permalink
  42. val preStepCommands: Seq[HString]

    Permalink
  43. def preconditions: Seq[Precondition]

    Permalink
    Definition Classes
    PipelineActivity
  44. def ref: AdpRef[AdpActivity]

    Permalink
    Definition Classes
    PipelineActivityPipelineObject
  45. def retryDelay: Option[HDuration]

    Permalink
    Definition Classes
    PipelineActivity
  46. def runsOn: Resource[A]

    Permalink
    Definition Classes
    PipelineActivity
  47. implicit def seq2Option[A](anySeq: Seq[A]): Option[Seq[A]]

    Permalink
    Definition Classes
    PipelineObject
  48. def seqToOption[A, B](anySeq: Seq[A])(transform: (A) ⇒ B): Option[Seq[B]]

    Permalink
    Definition Classes
    PipelineObject
  49. def serialize: AdpEmrActivity

    Permalink
  50. val steps: Seq[MapReduceStep]

    Permalink
  51. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  52. implicit def uniquePipelineId2String(id: PipelineObjectId): String

    Permalink
    Definition Classes
    PipelineObject
  53. def updateActivityFields(fields: ActivityFields[A]): MapReduceActivity[A]

    Permalink
    Definition Classes
    MapReduceActivityPipelineActivity
  54. def updateBaseFields(fields: BaseFields): MapReduceActivity[A]

    Permalink
    Definition Classes
    MapReduceActivityNamedPipelineObject
  55. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  56. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  57. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  58. def whenMet(conditions: Precondition*): Self

    Permalink
    Definition Classes
    PipelineActivity
  59. def withAttemptTimeout(duration: HDuration): Self

    Permalink
    Definition Classes
    PipelineActivity
  60. def withFailureAndRerunMode(mode: FailureAndRerunMode): Self

    Permalink
    Definition Classes
    PipelineActivity
  61. def withInput(input: S3DataNode*): MapReduceActivity[A]

    Permalink
  62. def withLateAfterTimeout(duration: HDuration): Self

    Permalink
    Definition Classes
    PipelineActivity
  63. def withMaximumRetries(retries: HInt): Self

    Permalink
    Definition Classes
    PipelineActivity
  64. def withOutput(output: S3DataNode*): MapReduceActivity[A]

    Permalink
  65. def withPostStepCommand(commands: HString*): Self

    Permalink
  66. def withPreStepCommand(commands: HString*): Self

    Permalink
  67. def withRetryDelay(duration: HDuration): Self

    Permalink
    Definition Classes
    PipelineActivity
  68. def withSteps(step: MapReduceStep*): MapReduceActivity[A]

    Permalink

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from EmrActivity[A]

Inherited from PipelineActivity[A]

Inherited from NamedPipelineObject

Inherited from PipelineObject

Inherited from Ordered[PipelineObject]

Inherited from Comparable[PipelineObject]

Inherited from AnyRef

Inherited from Any

Ungrouped