com.krux.hyperion.aws

AdpS3FileDataNode

case class AdpS3FileDataNode(id: String, name: Option[String], compression: Option[String], dataFormat: Option[AdpRef[AdpDataFormat]], filePath: String, manifestFilePath: Option[String], precondition: Option[Seq[AdpRef[AdpPrecondition]]], onSuccess: Option[Seq[AdpRef[AdpSnsAlarm]]], onFail: Option[Seq[AdpRef[AdpSnsAlarm]]]) extends AdpDataPipelineAbstractObject with AdpS3DataNode with Product with Serializable

You must provide either a filePath or directoryPath value.

Source
AdpDataNodes.scala
Linear Supertypes
Serializable, Serializable, Product, Equals, AdpS3DataNode, AdpDataNode, AdpDataPipelineObject, AdpDataPipelineAbstractObject, AdpObject, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. AdpS3FileDataNode
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. AdpS3DataNode
  7. AdpDataNode
  8. AdpDataPipelineObject
  9. AdpDataPipelineAbstractObject
  10. AdpObject
  11. AnyRef
  12. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new AdpS3FileDataNode(id: String, name: Option[String], compression: Option[String], dataFormat: Option[AdpRef[AdpDataFormat]], filePath: String, manifestFilePath: Option[String], precondition: Option[Seq[AdpRef[AdpPrecondition]]], onSuccess: Option[Seq[AdpRef[AdpSnsAlarm]]], onFail: Option[Seq[AdpRef[AdpSnsAlarm]]])

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. val compression: Option[String]

    The type of compression for the data described by the S3DataNode.

    The type of compression for the data described by the S3DataNode. none is no compression and gzip is compressed with the gzip algorithm. This field is only supported for use with Amazon Redshift and when you use S3DataNode with CopyActivit

    Definition Classes
    AdpS3FileDataNodeAdpS3DataNode
  9. val dataFormat: Option[AdpRef[AdpDataFormat]]

    The format of the data described by the S3DataNode.

    The format of the data described by the S3DataNode.

    Definition Classes
    AdpS3FileDataNodeAdpS3DataNode
  10. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  11. val filePath: String

  12. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  13. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  14. val id: String

    The ID of the object, IDs must be unique within a pipeline definition

    The ID of the object, IDs must be unique within a pipeline definition

    Definition Classes
    AdpS3FileDataNodeAdpDataPipelineObjectAdpDataPipelineAbstractObject
  15. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  16. val manifestFilePath: Option[String]

    The Amazon S3 path to a manifest file in the format supported by Amazon Redshift.

    The Amazon S3 path to a manifest file in the format supported by Amazon Redshift. AWS Data Pipeline uses the manifest file to copy the specified Amazon S3 files into the Amazon Redshift table. This field is valid only when a RedshiftCopyActivity references the S3DataNode. For more information, see Using a manifest to specify data files.

    Definition Classes
    AdpS3FileDataNodeAdpS3DataNode
  17. val name: Option[String]

    The optional, user-defined label of the object.

    The optional, user-defined label of the object. If you do not provide a name for an object in a pipeline definition, AWS Data Pipeline automatically duplicates the value of id.

    Definition Classes
    AdpS3FileDataNodeAdpDataPipelineObjectAdpDataPipelineAbstractObject
  18. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  19. final def notify(): Unit

    Definition Classes
    AnyRef
  20. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  21. val onFail: Option[Seq[AdpRef[AdpSnsAlarm]]]

    The SNS alarm to raise when the current instance fails.

    The SNS alarm to raise when the current instance fails.

    Definition Classes
    AdpS3FileDataNodeAdpDataNode
  22. val onSuccess: Option[Seq[AdpRef[AdpSnsAlarm]]]

    The SNS alarm to raise when the current instance succeeds.

    The SNS alarm to raise when the current instance succeeds.

    Definition Classes
    AdpS3FileDataNodeAdpDataNode
  23. val precondition: Option[Seq[AdpRef[AdpPrecondition]]]

    A list of precondition objects that must be true for the data node to be valid.

    A list of precondition objects that must be true for the data node to be valid. A data node cannot reach the READY status until all its conditions are met. Preconditions do not have their own schedule or identity, instead they run on the schedule of the activity or data node with which they are associated.

    Definition Classes
    AdpS3FileDataNodeAdpDataNode
  24. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  25. val type: String

    The type of object.

    The type of object. Use one of the predefined AWS Data Pipeline object types.

    Definition Classes
    AdpS3DataNodeAdpDataPipelineObject
  26. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AdpS3DataNode

Inherited from AdpDataNode

Inherited from AdpDataPipelineObject

Inherited from AdpObject

Inherited from AnyRef

Inherited from Any

Ungrouped