com.krux.hyperion.aws

AdpS3DataNode

trait AdpS3DataNode extends AdpDataPipelineAbstractObject with AdpDataNode

Defines a data node using Amazon S3.

Source
AdpDataNodes.scala
Linear Supertypes
AdpDataNode, AdpDataPipelineObject, AdpDataPipelineAbstractObject, AdpObject, AnyRef, Any
Known Subclasses
AdpS3DirectoryDataNode, AdpS3FileDataNode
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. AdpS3DataNode
  2. AdpDataNode
  3. AdpDataPipelineObject
  4. AdpDataPipelineAbstractObject
  5. AdpObject
  6. AnyRef
  7. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def compression: Option[String]

    The type of compression for the data described by the S3DataNode.

    The type of compression for the data described by the S3DataNode. none is no compression and gzip is compressed with the gzip algorithm. This field is only supported for use with Amazon Redshift and when you use S3DataNode with CopyActivit

  2. abstract def dataFormat: Option[AdpRef[AdpDataFormat]]

    The format of the data described by the S3DataNode.

  3. abstract def id: String

    The ID of the object, IDs must be unique within a pipeline definition

    The ID of the object, IDs must be unique within a pipeline definition

    Definition Classes
    AdpDataPipelineObject → AdpDataPipelineAbstractObject

  4. abstract def manifestFilePath: Option[String]

    The Amazon S3 path to a manifest file in the format supported by Amazon Redshift.

    The Amazon S3 path to a manifest file in the format supported by Amazon Redshift. AWS Data Pipeline uses the manifest file to copy the specified Amazon S3 files into the Amazon Redshift table. This field is valid only when a RedshiftCopyActivity references the S3DataNode. For more information, see Using a manifest to specify data files.

  5. abstract def name: Option[String]

    The optional, user-defined label of the object.

    The optional, user-defined label of the object. If you do not provide a name for an object in a pipeline definition, AWS Data Pipeline automatically duplicates the value of id.

    Definition Classes
    AdpDataPipelineObject → AdpDataPipelineAbstractObject

  6. abstract def onFail: Option[Seq[AdpRef[AdpSnsAlarm]]]

    The SNS alarm to raise when the current instance fails.

    The SNS alarm to raise when the current instance fails.

    Definition Classes
    AdpDataNode

  7. abstract def onSuccess: Option[Seq[AdpRef[AdpSnsAlarm]]]

    The SNS alarm to raise when the current instance succeeds.

    The SNS alarm to raise when the current instance succeeds.

    Definition Classes
    AdpDataNode

  8. abstract def precondition: Option[Seq[AdpRef[AdpPrecondition]]]

    A list of precondition objects that must be true for the data node to be valid.

    A list of precondition objects that must be true for the data node to be valid. A data node cannot reach the READY status until all its conditions are met. Preconditions do not have their own schedule or identity, instead they run on the schedule of the activity or data node with which they are associated.

    Definition Classes
    AdpDataNode

Concrete Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  9. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  10. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  11. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  12. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  13. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  14. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  15. final def notify(): Unit

    Definition Classes
    AnyRef

  16. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  17. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  18. def toString(): String

    Definition Classes
    AnyRef → Any

  19. val type: String

    The type of object.

    The type of object. Use one of the predefined AWS Data Pipeline object types.

    Definition Classes
    AdpS3DataNode → AdpDataPipelineObject

  20. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  21. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  22. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AdpDataNode

Inherited from AdpDataPipelineObject

Inherited from AdpDataPipelineAbstractObject

Inherited from AdpObject

Inherited from AnyRef

Inherited from Any

Ungrouped