Packages

abstract class Buffer[T <: Serializable] extends AnyRef

A buffer is used in between stages. It is often an external source that stores and queues elements (like Kafka).

T

Type of this buffer.

Linear Supertypes
AnyRef, Any
Known Subclasses
KafkaBuffer
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Buffer
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new Buffer(pipeline: Pipeline, properties: Properties, relatedStageName: String)(implicit arg0: ClassTag[T], arg1: scala.reflect.api.JavaUniverse.TypeTag[T])

    pipeline

    The pipeline for which we use this Buffer.

    properties

    The properties of this buffer.

    relatedStageName

    The name of the related stage the buffer is linked to. We need this to for instance set the topic id.

Abstract Value Members

  1. abstract def getSink: SinkFunction[T]

    Get the sink function for this buffer.

    Get the sink function for this buffer. A stage writes to this.

    returns

    The SinkFunction retrieved from a Buffer.

  2. abstract def getSource: DataStream[T]

    Get the source for this buffer.

    Get the source for this buffer. A stage reads from this.

    returns

    The DataStream retrieved from a Buffer.

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @native() @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  10. def getProperties: Properties

    Returns the properties of this buffer.

  11. def getSerializer: AbstractSerde[T]

    Get serializer/deserializer of elements for a buffer.

    Get serializer/deserializer of elements for a buffer. Defaults to JSON.

    returns

    The configured serializer.

  12. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  13. val inputClassType: Class[T]
  14. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  15. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  16. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  18. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  19. def toString(): String
    Definition Classes
    AnyRef → Any
  20. implicit val typeInfo: TypeInformation[T]
  21. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped