Packages

c

org.codefeedr.buffer

KafkaTopic

class KafkaTopic[T <: Serializable] extends FakeStage[T]

KafkaTopic stage which only embodies the topic name, to let a linked stage read from this topic.

Linear Supertypes
FakeStage[T], InputStage[T], Stage[Nothing, T], AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. KafkaTopic
  2. FakeStage
  3. InputStage
  4. Stage
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new KafkaTopic(topic: String)(implicit arg0: ClassTag[T], arg1: scala.reflect.api.JavaUniverse.TypeTag[T])

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. def :+[U <: Serializable, V <: Serializable](stage: Stage[U, V]): StageList

    Create a list of stages by appending another stage.

    Create a list of stages by appending another stage.

    stage

    The other stage to add.

    returns

    A new StageList with the stage added.

    Definition Classes
    Stage
  4. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate() @throws( ... )
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  9. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  10. def getContext: Context

    Get the Context of this stage.

    Get the Context of this stage.

    Definition Classes
    Stage
  11. def getMainSource(groupId: String = null): DataStream[Nothing]

    Returns the (main)buffer source of this stage.

    Returns the (main)buffer source of this stage. The main source is the first parent of this stage. Other sources need to be joined in the Flink job.

    returns

    The DataStream resulting from the buffer.

    Definition Classes
    Stage
  12. def getParents: Vector[Stage[Serializable, Serializable]]

    Get all parents of this stage.

    Get all parents of this stage.

    returns

    The parents of this stage, can be empty.

    Definition Classes
    Stage
  13. def getSink(groupId: String = null): SinkFunction[T]

    Returns the buffer sink of this stage.

    Returns the buffer sink of this stage.

    returns

    The SinkFunction resulting from the buffer.

    Definition Classes
    Stage
  14. def getSource[T <: Serializable](parentNode: Stage[Serializable, Serializable])(implicit arg0: ClassTag[T], arg1: scala.reflect.api.JavaUniverse.TypeTag[T]): DataStream[T]

    Returns the buffer source of this stage.

    Returns the buffer source of this stage.

    returns

    The DataStream resulting from the buffer.

    Definition Classes
    Stage
  15. def hasMainSource: Boolean

    Check if this stage is sourced from a org.codefeedr.buffer.Buffer.

    Check if this stage is sourced from a org.codefeedr.buffer.Buffer.

    returns

    True if this stage has a Buffer source.

    Definition Classes
    Stage
  16. def hasSink: Boolean

    Check if this stage is sinked to a org.codefeedr.buffer.Buffer.

    Check if this stage is sinked to a org.codefeedr.buffer.Buffer.

    returns

    True if this stage has a Buffer sink.

    Definition Classes
    Stage
  17. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  18. val id: String

    Get the id of this stage

    Get the id of this stage

    Attributes
    protected[org.codefeedr]
    Definition Classes
    Stage
  19. def inList: StageList

    Create a StageList with this stage.

    Create a StageList with this stage.

    returns

    StageList containing this stage.

    Definition Classes
    Stage
  20. var inTypes: List[scala.reflect.api.JavaUniverse.Type]

    Keep track of all incoming types.

    Keep track of all incoming types. *

    Definition Classes
    Stage
  21. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  22. def main(context: Context): DataStream[T]

    This will never be run.

    This will never be run.

    returns

    A newly created DataStream.

    Definition Classes
    KafkaTopic → InputStage
  23. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  24. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  25. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  26. val outType: scala.reflect.api.JavaUniverse.Type

    Keep track of the outgoing type.

    Keep track of the outgoing type. *

    Definition Classes
    Stage
  27. def setUp(pipeline: Pipeline): Unit

    Setups the pipeline object with a pipeline.

    Setups the pipeline object with a pipeline.

    pipeline

    The pipeline it belongs to.

    Definition Classes
    Stage
  28. val stageId: Option[String]
    Definition Classes
    Stage
  29. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  30. def toString(): String
    Definition Classes
    AnyRef → Any
  31. def transform(source: DataStream[Nothing]): DataStream[T]

    Transforms the stage from its input type to its output type.

    Transforms the stage from its input type to its output type. This requires using the Flink DataStream API.

    In this case it is already implemented as a helper method. To use main(): DataStream[Out] instead.

    source

    The input source with type In. In the case of an InputStage it is a NoType.

    returns

    The transformed stream with type Out.

    Definition Classes
    InputStage → Stage
  32. def verifyGraph(graph: DirectedAcyclicGraph): Unit

    Verify that the stage is valid.

    Verify that the stage is valid. Checks types of the input sources and whether the graph is configured correctly for the types.

    Attributes
    protected[org.codefeedr.pipeline]
    Definition Classes
    Stage
  33. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  34. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @throws( ... )
  35. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @Deprecated @deprecated @throws( classOf[java.lang.Throwable] )
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from FakeStage[T]

Inherited from InputStage[T]

Inherited from Stage[Nothing, T]

Inherited from AnyRef

Inherited from Any

Ungrouped