com.intenthq.pucket.mapreduce

PucketOutputFormat

class PucketOutputFormat[T] extends FileOutputFormat[Void, T]

Implementation of output format for hadoop

T

Type of data to be written

Linear Supertypes
FileOutputFormat[Void, T], OutputFormat[Void, T], AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. PucketOutputFormat
  2. FileOutputFormat
  3. OutputFormat
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new PucketOutputFormat()

Type Members

  1. case class PucketRecordWriter(writer: Writer[T, Throwable]) extends RecordWriter[Void, T] with Product with Serializable

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def checkOutputSpecs(arg0: JobContext): Unit

    Definition Classes
    FileOutputFormat → OutputFormat
    Annotations
    @throws( classOf[java.io.IOException] ) @throws( ... )
  8. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  11. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  13. def getDefaultWorkFile(arg0: TaskAttemptContext, arg1: String): Path

    Definition Classes
    FileOutputFormat
    Annotations
    @throws( classOf[java.io.IOException] )
  14. def getOutputCommitter(context: TaskAttemptContext): OutputCommitter

    Definition Classes
    PucketOutputFormat → FileOutputFormat → OutputFormat
  15. def getPucket(conf: Configuration, path: Path, fs: FileSystem): \/[Throwable, Pucket[T]]

    Create a pucket from the configuration settings Uses reflection to instantiate a new instance of the pucket

    Create a pucket from the configuration settings Uses reflection to instantiate a new instance of the pucket

    conf

    hadoop configuration instance

    path

    path to the pucket

    fs

    hadoop filesystem instance

    returns

    a new pucket or error if validation fails

  16. def getRecordWriter(context: TaskAttemptContext): RecordWriter[Void, T]

    <invalid inheritdoc annotation>

    <invalid inheritdoc annotation>

    Definition Classes
    PucketOutputFormat → FileOutputFormat → OutputFormat
  17. def getWriter(pucket: Pucket[T]): \/[Throwable, Writer[T, Throwable]]

    Get a writer for the task

    Get a writer for the task

    pucket

    the pucket to be written to

    returns

    a standard writer or partitoned writer if a partitioner is present in the descriptor, or an error if validation fails

  18. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  19. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  20. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  21. final def notify(): Unit

    Definition Classes
    AnyRef
  22. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  23. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  24. def toString(): String

    Definition Classes
    AnyRef → Any
  25. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from FileOutputFormat[Void, T]

Inherited from OutputFormat[Void, T]

Inherited from AnyRef

Inherited from Any

Ungrouped