com.krux.hyperion.aws

AdpEmrCluster

class AdpEmrCluster extends AdpDataPipelineAbstractObject with AdpResource

Represents the configuration of an Amazon EMR cluster. This object is used by EmrActivity to launch a cluster.

Source
AdpResources.scala
Linear Supertypes
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. AdpEmrCluster
  2. AdpResource
  3. AdpDataPipelineObject
  4. AdpDataPipelineAbstractObject
  5. AdpObject
  6. AnyRef
  7. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new AdpEmrCluster(id: String, name: Option[String], amiVersion: Option[String], supportedProducts: Option[String], bootstrapAction: Seq[String], enableDebugging: Option[String], hadoopSchedulerType: Option[String], keyPair: Option[String], masterInstanceBidPrice: Option[String], masterInstanceType: Option[String], coreInstanceBidPrice: Option[String], coreInstanceCount: Option[String], coreInstanceType: Option[String], taskInstanceBidPrice: Option[String], taskInstanceCount: Option[String], taskInstanceType: Option[String], region: Option[String], availabilityZone: Option[String], resourceRole: Option[String], role: Option[String], subnetId: Option[String], masterSecurityGroupId: Option[String], additionalMasterSecurityGroupIds: Option[Seq[String]], slaveSecurityGroupId: Option[String], additionalSlaveSecurityGroupIds: Option[Seq[String]], useOnDemandOnLastAttempt: Option[String], visibleToAllUsers: Option[String], initTimeout: Option[String], terminateAfter: Option[String], actionOnResourceFailure: Option[String], actionOnTaskFailure: Option[String])

    amiVersion

    The Amazon Machine Image (AMI) version to use by Amazon EMR to install the cluster nodes.

    supportedProducts

    A parameter that installs third-party software on an Amazon EMR cluster, for example installing a third-party distribution of Hadoop.

    bootstrapAction

    An action to run when the cluster starts. You can specify comma-separated arguments. To specify multiple actions, up to 255, add multiple bootstrapAction fields. The default behavior is to start the cluster without any bootstrap actions.

    enableDebugging

    Enables debugging on the Amazon EMR cluster.

    keyPair

    The Amazon EC2 key pair to use to log onto the master node of the cluster. The default action is not to attach a key pair to the cluster.

    masterInstanceType

    The type of EC2 instance to use for the master node. The default value is m1.small.

    coreInstanceCount

    The number of core nodes to use for the cluster. The default value is 1.

    coreInstanceType

    The type of EC2 instance to use for core nodes. The default value is m1.small.

    taskInstanceBidPrice

    The maximum dollar amount for your Spot Instance bid and is a decimal value between 0 and 20.00 exclusive. Setting this value enables Spot Instances for the EMR cluster task nodes.

    taskInstanceCount

    The number of task nodes to use for the cluster. The default value is 1.

    taskInstanceType

    The type of EC2 instance to use for task nodes.

    region

    A region code to specify that the resource should run in a different region.

    subnetId

    The ID of the subnet to launch the instance into.

    terminateAfter

    The amount of time to wait before terminating the resource.

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. val actionOnResourceFailure: Option[String]

  7. val actionOnTaskFailure: Option[String]

  8. val additionalMasterSecurityGroupIds: Option[Seq[String]]

  9. val additionalSlaveSecurityGroupIds: Option[Seq[String]]

  10. val amiVersion: Option[String]

    The Amazon Machine Image (AMI) version to use by Amazon EMR to install the cluster nodes.

  11. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  12. val availabilityZone: Option[String]

  13. val bootstrapAction: Seq[String]

    An action to run when the cluster starts.

    An action to run when the cluster starts. You can specify comma-separated arguments. To specify multiple actions, up to 255, add multiple bootstrapAction fields. The default behavior is to start the cluster without any bootstrap actions.

  14. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  15. val coreInstanceBidPrice: Option[String]

  16. val coreInstanceCount: Option[String]

    The number of core nodes to use for the cluster.

    The number of core nodes to use for the cluster. The default value is 1.

  17. val coreInstanceType: Option[String]

    The type of EC2 instance to use for core nodes.

    The type of EC2 instance to use for core nodes. The default value is m1.small.

  18. val enableDebugging: Option[String]

    Enables debugging on the Amazon EMR cluster.

  19. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  20. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  21. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  22. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  23. val hadoopSchedulerType: Option[String]

  24. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  25. val id: String

    The ID of the object, IDs must be unique within a pipeline definition

    The ID of the object, IDs must be unique within a pipeline definition

    Definition Classes
    AdpEmrClusterAdpDataPipelineObjectAdpObject
  26. val initTimeout: Option[String]

  27. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  28. val keyPair: Option[String]

    The Amazon EC2 key pair to use to log onto the master node of the cluster.

    The Amazon EC2 key pair to use to log onto the master node of the cluster. The default action is not to attach a key pair to the cluster.

    Definition Classes
    AdpEmrClusterAdpResource
  29. val masterInstanceBidPrice: Option[String]

  30. val masterInstanceType: Option[String]

    The type of EC2 instance to use for the master node.

    The type of EC2 instance to use for the master node. The default value is m1.small.

  31. val masterSecurityGroupId: Option[String]

  32. val name: Option[String]

    The optional, user-defined label of the object.

    The optional, user-defined label of the object. If you do not provide a name for an object in a pipeline definition, AWS Data Pipeline automatically duplicates the value of id.

    Definition Classes
    AdpEmrClusterAdpDataPipelineObjectAdpDataPipelineAbstractObject
  33. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  34. final def notify(): Unit

    Definition Classes
    AnyRef
  35. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  36. val region: Option[String]

    A region code to specify that the resource should run in a different region.

    A region code to specify that the resource should run in a different region.

    Definition Classes
    AdpEmrClusterAdpResource
  37. val resourceRole: Option[String]

  38. val role: Option[String]

  39. val slaveSecurityGroupId: Option[String]

  40. val subnetId: Option[String]

    The ID of the subnet to launch the instance into.

  41. val supportedProducts: Option[String]

    A parameter that installs third-party software on an Amazon EMR cluster, for example installing a third-party distribution of Hadoop.

  42. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  43. val taskInstanceBidPrice: Option[String]

    The maximum dollar amount for your Spot Instance bid and is a decimal value between 0 and 20.

    The maximum dollar amount for your Spot Instance bid and is a decimal value between 0 and 20.00 exclusive. Setting this value enables Spot Instances for the EMR cluster task nodes.

  44. val taskInstanceCount: Option[String]

    The number of task nodes to use for the cluster.

    The number of task nodes to use for the cluster. The default value is 1.

  45. val taskInstanceType: Option[String]

    The type of EC2 instance to use for task nodes.

  46. val terminateAfter: Option[String]

    The amount of time to wait before terminating the resource.

    The amount of time to wait before terminating the resource.

    Definition Classes
    AdpEmrClusterAdpResource
  47. def toString(): String

    Definition Classes
    AnyRef → Any
  48. val type: String

    The type of object.

    The type of object. Use one of the predefined AWS Data Pipeline object types.

    Definition Classes
    AdpEmrClusterAdpDataPipelineObject
  49. val useOnDemandOnLastAttempt: Option[String]

  50. val visibleToAllUsers: Option[String]

  51. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  52. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  53. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AdpResource

Inherited from AdpDataPipelineObject

Inherited from AdpObject

Inherited from AnyRef

Inherited from Any

Ungrouped