com.krux.hyperion.aws

AdpEmrCluster

Related Doc: package aws

class AdpEmrCluster extends AdpDataPipelineAbstractObject with AdpResource

Represents the configuration of an Amazon EMR cluster. This object is used by EmrActivity to launch a cluster.

Source
AdpResources.scala
Linear Supertypes
AdpResource, AdpDataPipelineObject, AdpDataPipelineAbstractObject, AdpObject, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. AdpEmrCluster
  2. AdpResource
  3. AdpDataPipelineObject
  4. AdpDataPipelineAbstractObject
  5. AdpObject
  6. AnyRef
  7. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new AdpEmrCluster(id: String, name: Option[String], bootstrapAction: Seq[String], amiVersion: Option[String], masterInstanceType: Option[String], coreInstanceType: Option[String], coreInstanceCount: Option[String], taskInstanceType: Option[String], taskInstanceCount: Option[String], taskInstanceBidPrice: Option[String], terminateAfter: String, keyPair: Option[String], region: Option[String], enableDebugging: Option[String], supportedProducts: Option[String], subnetId: Option[String], role: Option[String], resourceRole: Option[String], availabilityZone: Option[String], coreInstanceBidPrice: Option[Double], masterInstanceBidPrice: Option[Double], useOnDemandOnLastAttempt: Option[Boolean], visibleToAllUsers: Option[Boolean], masterSecurityGroupId: Option[String], slaveSecurityGroupId: Option[String], additionalMasterSecurityGroupIds: Option[Seq[String]], additionalSlaveSecurityGroupIds: Option[Seq[String]], hadoopSchedulerType: Option[String], actionOnResourceFailure: Option[String], actionOnTaskFailure: Option[String])

    bootstrapAction

    An action to run when the cluster starts. You can specify comma-separated arguments. To specify multiple actions, up to 255, add multiple bootstrapAction fields. The default behavior is to start the cluster without any bootstrap actions.

    amiVersion

    The Amazon Machine Image (AMI) version to use by Amazon EMR to install the cluster nodes.

    masterInstanceType

    The type of EC2 instance to use for the master node. The default value is m1.small.

    coreInstanceType

    The type of EC2 instance to use for core nodes. The default value is m1.small.

    coreInstanceCount

    The number of core nodes to use for the cluster. The default value is 1.

    taskInstanceType

    The type of EC2 instance to use for task nodes.

    taskInstanceCount

    The number of task nodes to use for the cluster. The default value is 1.

    taskInstanceBidPrice

    The maximum dollar amount for your Spot Instance bid and is a decimal value between 0 and 20.00 exclusive. Setting this value enables Spot Instances for the EMR cluster task nodes.

    terminateAfter

    The amount of time to wait before terminating the resource.

    keyPair

    The Amazon EC2 key pair to use to log onto the master node of the cluster. The default action is not to attach a key pair to the cluster.

    region

    A region code to specify that the resource should run in a different region.

    enableDebugging

    Enables debugging on the Amazon EMR cluster.

    supportedProducts

    A parameter that installs third-party software on an Amazon EMR cluster, for example installing a third-party distribution of Hadoop.

    subnetId

    The ID of the subnet to launch the instance into.

Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  4. val actionOnResourceFailure: Option[String]

  5. val actionOnTaskFailure: Option[String]

  6. val additionalMasterSecurityGroupIds: Option[Seq[String]]

  7. val additionalSlaveSecurityGroupIds: Option[Seq[String]]

  8. val amiVersion: Option[String]

    The Amazon Machine Image (AMI) version to use by Amazon EMR to install the cluster nodes.

  9. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  10. val availabilityZone: Option[String]

  11. val bootstrapAction: Seq[String]

    An action to run when the cluster starts.

    An action to run when the cluster starts. You can specify comma-separated arguments. To specify multiple actions, up to 255, add multiple bootstrapAction fields. The default behavior is to start the cluster without any bootstrap actions.

  12. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  13. val coreInstanceBidPrice: Option[Double]

  14. val coreInstanceCount: Option[String]

    The number of core nodes to use for the cluster.

    The number of core nodes to use for the cluster. The default value is 1.

  15. val coreInstanceType: Option[String]

    The type of EC2 instance to use for core nodes.

    The type of EC2 instance to use for core nodes. The default value is m1.small.

  16. val enableDebugging: Option[String]

    Enables debugging on the Amazon EMR cluster.

  17. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  18. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  19. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  20. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  21. val hadoopSchedulerType: Option[String]

  22. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  23. val id: String

    The ID of the object, IDs must be unique within a pipeline definition

    The ID of the object, IDs must be unique within a pipeline definition

    Definition Classes
    AdpEmrCluster → AdpDataPipelineObject → AdpDataPipelineAbstractObject

  24. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  25. val keyPair: Option[String]

    The Amazon EC2 key pair to use to log onto the master node of the cluster.

    The Amazon EC2 key pair to use to log onto the master node of the cluster. The default action is not to attach a key pair to the cluster.

    Definition Classes
    AdpEmrCluster → AdpResource

  26. val masterInstanceBidPrice: Option[Double]

  27. val masterInstanceType: Option[String]

    The type of EC2 instance to use for the master node.

    The type of EC2 instance to use for the master node. The default value is m1.small.

  28. val masterSecurityGroupId: Option[String]

  29. val name: Option[String]

    The optional, user-defined label of the object.

    The optional, user-defined label of the object. If you do not provide a name for an object in a pipeline definition, AWS Data Pipeline automatically duplicates the value of id.

    Definition Classes
    AdpEmrCluster → AdpDataPipelineObject → AdpDataPipelineAbstractObject

  30. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  31. final def notify(): Unit

    Definition Classes
    AnyRef

  32. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  33. val region: Option[String]

    A region code to specify that the resource should run in a different region.

    A region code to specify that the resource should run in a different region.

    Definition Classes
    AdpEmrCluster → AdpResource

  34. val resourceRole: Option[String]

  35. val role: Option[String]

  36. val slaveSecurityGroupId: Option[String]

  37. val subnetId: Option[String]

    The ID of the subnet to launch the instance into.

  38. val supportedProducts: Option[String]

    A parameter that installs third-party software on an Amazon EMR cluster, for example installing a third-party distribution of Hadoop.

  39. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  40. val taskInstanceBidPrice: Option[String]

    The maximum dollar amount for your Spot Instance bid and is a decimal value between 0 and 20.00 exclusive.

    The maximum dollar amount for your Spot Instance bid and is a decimal value between 0 and 20.00 exclusive. Setting this value enables Spot Instances for the EMR cluster task nodes.

  41. val taskInstanceCount: Option[String]

    The number of task nodes to use for the cluster.

    The number of task nodes to use for the cluster. The default value is 1.

  42. val taskInstanceType: Option[String]

    The type of EC2 instance to use for task nodes.

  43. val terminateAfter: String

    The amount of time to wait before terminating the resource.

    The amount of time to wait before terminating the resource.

    Definition Classes
    AdpEmrCluster → AdpResource

  44. def toString(): String

    Definition Classes
    AnyRef → Any

  45. val type: String

    The type of object.

    The type of object. Use one of the predefined AWS Data Pipeline object types.

    Definition Classes
    AdpEmrCluster → AdpDataPipelineObject

  46. val useOnDemandOnLastAttempt: Option[Boolean]

  47. val visibleToAllUsers: Option[Boolean]

  48. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  49. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  50. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AdpResource

Inherited from AdpDataPipelineObject

Inherited from AdpDataPipelineAbstractObject

Inherited from AdpObject

Inherited from AnyRef

Inherited from Any

Ungrouped