com.ignition.stream

Filter

case class Filter(condition: String) extends StreamSplitter with Product with Serializable

Filters the stream based on a combination of boolean conditions against fields.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. Filter
  2. Product
  3. Equals
  4. StreamSplitter
  5. StreamStep
  6. Splitter
  7. MultiOutputStep
  8. SingleInputStep
  9. ConnectionTarget
  10. Step
  11. JsonExport
  12. XmlExport
  13. AbstractStep
  14. Serializable
  15. Serializable
  16. AnyRef
  17. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new Filter(condition: String)

Type Members

  1. case class OutPort(index: Int) extends ConnectionSource[T, R] with Product with Serializable

    Definition Classes
    MultiOutputStep

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. def -->(targets: ConnectionTarget[DataStream, SparkStreamingRuntime]*): Unit

    Definition Classes
    MultiOutputStep
  5. def -->(tgt: MultiInputStep[DataStream, SparkStreamingRuntime]): tgt.type

    Definition Classes
    MultiOutputStep
  6. def -->(tgt: ConnectionTarget[DataStream, SparkStreamingRuntime]): tgt.type

    Definition Classes
    MultiOutputStep
  7. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  8. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  9. def addStepListener(listener: StepListener[DataStream, SparkStreamingRuntime]): Unit

    Registers a new listener.

    Registers a new listener.

    Definition Classes
    Step
  10. def addStreamDataListener(listener: StreamStepDataListener): Unit

    Registers a data listener.

    Registers a data listener.

    Definition Classes
    StreamStep
  11. def allInputsRequired: Boolean

    Specifies if the step should throw an error if one of the inputs is not connected.

    Specifies if the step should throw an error if one of the inputs is not connected.

    Definition Classes
    Step
  12. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  13. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  14. def compute(arg: DataStream, index: Int)(implicit runtime: SparkStreamingRuntime): DataStream

    Attributes
    protected
    Definition Classes
    FilterSplitter
  15. def compute(index: Int)(implicit runtime: SparkStreamingRuntime): DataStream

    Triggers listener notification on stream events.

    Triggers listener notification on stream events.

    index

    the output value index.

    Attributes
    protected
    Definition Classes
    StreamStepStep
  16. val condition: String

  17. def ctx(implicit runtime: SparkStreamingRuntime): SQLContext

    Returns the implicit SQLContext.

    Returns the implicit SQLContext.

    Attributes
    protected
    Definition Classes
    StreamStep
  18. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  19. final def evaluate(implicit runtime: SparkStreamingRuntime): IndexedSeq[DataStream]

    Evaluates all step's outputs and returns a list of results.

    Evaluates all step's outputs and returns a list of results.

    Definition Classes
    Step
    Annotations
    @throws( classOf[ExecutionException] )
  20. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  21. def from(src: ConnectionSource[DataStream, SparkStreamingRuntime]): Filter.this.type

    Definition Classes
    ConnectionTarget
  22. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  23. val index: Int

    Definition Classes
    SingleInputStepConnectionTarget
  24. def input(implicit runtime: SparkStreamingRuntime): DataStream

    Definition Classes
    SingleInputStep
  25. val inputCount: Int

    The maximum number of input ports.

    The maximum number of input ports.

    Definition Classes
    SingleInputStepStep
  26. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  27. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  28. final def notify(): Unit

    Definition Classes
    AnyRef
  29. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  30. val out: LazyArray[OutPort]

    Definition Classes
    MultiOutputStep
  31. def outbounds(index: Int): OutPort

    Definition Classes
    MultiOutputStep
  32. final def output(implicit runtime: SparkStreamingRuntime): DataStream

    Shortcut for output(0).

    Shortcut for output(0). Computes a step output at index 0.

    Definition Classes
    Step
    Annotations
    @throws( classOf[ExecutionException] )
    Exceptions thrown
    ExecutionException

    in case of an error, or if the step is not connected.

  33. final def output(index: Int)(implicit runtime: SparkStreamingRuntime): DataStream

    Computes a step output value at the specified index.

    Computes a step output value at the specified index.

    index

    the output value index.

    Definition Classes
    Step
    Annotations
    @throws( classOf[ExecutionException] )
    Exceptions thrown
    ExecutionException

    in case of an error, or if the step is not connected.

  34. val outputCount: Int

    The number of output ports.

    The number of output ports.

    Definition Classes
    StreamSplitterStep
  35. def register(implicit rt: SparkStreamingRuntime): Unit

    Registers the step with the runtime.

    Registers the step with the runtime. Subsequent restarts will keep binding the step to newly created contexts.

    Definition Classes
    StreamStep
  36. def removeStepListener(listener: StepListener[DataStream, SparkStreamingRuntime]): Unit

    Unregisters a listener.

    Unregisters a listener.

    Definition Classes
    Step
  37. def removeStreamDataListener(listener: StreamStepDataListener): Unit

    Unregisters a data listener.

    Unregisters a data listener.

    Definition Classes
    StreamStep
  38. def resetCache(predecessors: Boolean, descendants: Boolean): Unit

    Clears the cache of this step and optionally that of its predecessors and descendants.

    Clears the cache of this step and optionally that of its predecessors and descendants.

    Definition Classes
    Step
  39. def sc(implicit runtime: SparkStreamingRuntime): SparkContext

    Returns the implicit SparkContext.

    Returns the implicit SparkContext.

    Attributes
    protected
    Definition Classes
    StreamStep
  40. def ssc(implicit runtime: SparkStreamingRuntime): StreamingContext

    Returns the implicit StreamingContext.

    Returns the implicit StreamingContext.

    Attributes
    protected
    Definition Classes
    StreamStep
  41. val step: SingleInputStep[DataStream, SparkStreamingRuntime]

    Definition Classes
    SingleInputStepConnectionTarget
  42. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  43. def to(targets: ConnectionTarget[DataStream, SparkStreamingRuntime]*): Unit

    Definition Classes
    MultiOutputStep
  44. def to(tgt: MultiInputStep[DataStream, SparkStreamingRuntime]): tgt.type

    Definition Classes
    MultiOutputStep
  45. def to(tgt: ConnectionTarget[DataStream, SparkStreamingRuntime]): tgt.type

    Definition Classes
    MultiOutputStep
  46. def toJson: JValue

    Definition Classes
    FilterJsonExport
  47. def toXml: Elem

    Definition Classes
    FilterXmlExport
  48. def unregister(implicit rt: SparkStreamingRuntime): Unit

    Unregisters the step with the runtime.

    Unregisters the step with the runtime. After the restart, the step will no longer be bound to the active context.

    Definition Classes
    StreamStep
  49. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  50. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  51. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  52. final def wrap[U](body: ⇒ U): U

    Wraps exceptions into ExecutionException instances.

    Wraps exceptions into ExecutionException instances.

    Attributes
    protected
    Definition Classes
    AbstractStep

Inherited from Product

Inherited from Equals

Inherited from StreamSplitter

Inherited from StreamStep

Inherited from JsonExport

Inherited from XmlExport

Inherited from AbstractStep

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped