KafkaInput

Value Members

1. final def !=(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

2. final def !=(arg0: Any): Boolean

   Definition Classes

   Any

3. final def ##(): Int

   Definition Classes

   AnyRef → Any

4. def -->(targets: ConnectionTarget[DataStream, SparkStreamingRuntime]*): Unit

   Definition Classes

   ConnectionSource

5. def -->(tgt: MultiInputStep[DataStream, SparkStreamingRuntime]): tgt.type

   Definition Classes

   ConnectionSource

6. def -->(tgt: ConnectionTarget[DataStream, SparkStreamingRuntime]): tgt.type

   Definition Classes

   ConnectionSource

7. final def ==(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

8. final def ==(arg0: Any): Boolean

   Definition Classes

   Any

9. def addStepListener(listener: StepListener[DataStream, SparkStreamingRuntime]): Unit

   Registers a new listener.

   Registers a new listener.

   Definition Classes

   Step

10. def addStreamDataListener(listener: StreamStepDataListener): Unit

    Registers a data listener.

    Registers a data listener.

    Definition Classes

    StreamStep

11. def allInputsRequired: Boolean

    Specifies if the step should throw an error if one of the inputs is not connected.

    Specifies if the step should throw an error if one of the inputs is not connected.

    Definition Classes

    Step

12. final def asInstanceOf[T0]: T0

    Definition Classes

    Any

13. def brokers(hosts: String): KafkaInput

14. def brokers(hosts: String*): KafkaInput

15. val brokers: Iterable[String]

16. def clone(): AnyRef

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

17. def compute(implicit runtime: SparkStreamingRuntime): DataStream

    Attributes

    protected

    Definition Classes

    KafkaInput → Producer

18. def compute(index: Int)(implicit runtime: SparkStreamingRuntime): DataStream

    Triggers listener notification on stream events.

    Triggers listener notification on stream events.

    index

    the output value index.

    Attributes

    protected

    Definition Classes

    StreamStep → Step

19. def ctx(implicit runtime: SparkStreamingRuntime): SQLContext

    Returns the implicit SQLContext.

    Returns the implicit SQLContext.

    Attributes

    protected

    Definition Classes

    StreamStep

20. final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

21. final def evaluate(implicit runtime: SparkStreamingRuntime): IndexedSeq[DataStream]

    Evaluates all step's outputs and returns a list of results.

    Evaluates all step's outputs and returns a list of results.

    Definition Classes

    Step

    Annotations

    @throws( classOf[ExecutionException] )

22. val field: String

23. def finalize(): Unit

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

24. final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

25. val index: Int

    Definition Classes

    SingleOutputStep → ConnectionSource

26. val inputCount: Int

    The maximum number of input ports.

    The maximum number of input ports.

    Definition Classes

    NoInputStep → Step

27. final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

28. val kafkaProperties: Map[String, String]

29. final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

30. final def notify(): Unit

    Definition Classes

    AnyRef

31. final def notifyAll(): Unit

    Definition Classes

    AnyRef

32. def outbounds(index: Int): SingleOutputStep[DataStream, SparkStreamingRuntime]

    Definition Classes

    SingleOutputStep

33. final def output(implicit runtime: SparkStreamingRuntime): DataStream

    Shortcut for output(0).

    Shortcut for output(0). Computes a step output at index 0.

    Definition Classes

    Step

    Annotations

    @throws( classOf[ExecutionException] )

    Exceptions thrown

    ExecutionException

    in case of an error, or if the step is not connected.

34. final def output(index: Int)(implicit runtime: SparkStreamingRuntime): DataStream

    Computes a step output value at the specified index.

    Computes a step output value at the specified index.

    index

    the output value index.

    Definition Classes

    Step

    Annotations

    @throws( classOf[ExecutionException] )

    Exceptions thrown

    ExecutionException

    in case of an error, or if the step is not connected.

35. val outputCount: Int

    The number of output ports.

    The number of output ports.

    Definition Classes

    SingleOutputStep → Step

36. def properties(prop: (String, String)*): KafkaInput

37. def register(implicit rt: SparkStreamingRuntime): Unit

    Registers the step with the runtime.

    Registers the step with the runtime. Subsequent restarts will keep binding the step to newly created contexts.

    Definition Classes

    StreamStep

38. def removeStepListener(listener: StepListener[DataStream, SparkStreamingRuntime]): Unit

    Unregisters a listener.

    Unregisters a listener.

    Definition Classes

    Step

39. def removeStreamDataListener(listener: StreamStepDataListener): Unit

    Unregisters a data listener.

    Unregisters a data listener.

    Definition Classes

    StreamStep

40. def resetCache(predecessors: Boolean, descendants: Boolean): Unit

    Clears the cache of this step and optionally that of its predecessors and descendants.

    Clears the cache of this step and optionally that of its predecessors and descendants.

    Definition Classes

    Step

41. def sc(implicit runtime: SparkStreamingRuntime): SparkContext

    Returns the implicit SparkContext.

    Returns the implicit SparkContext.

    Attributes

    protected

    Definition Classes

    StreamStep

42. val schema: StructField

43. def ssc(implicit runtime: SparkStreamingRuntime): StreamingContext

    Returns the implicit StreamingContext.

    Returns the implicit StreamingContext.

    Attributes

    protected

    Definition Classes

    StreamStep

44. val step: SingleOutputStep[DataStream, SparkStreamingRuntime]

    Definition Classes

    SingleOutputStep → ConnectionSource

45. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

46. def to(targets: ConnectionTarget[DataStream, SparkStreamingRuntime]*): Unit

    Definition Classes

    ConnectionSource

47. def to(tgt: MultiInputStep[DataStream, SparkStreamingRuntime]): tgt.type

    Definition Classes

    ConnectionSource

48. def to(tgt: ConnectionTarget[DataStream, SparkStreamingRuntime]): tgt.type

    Definition Classes

    ConnectionSource

49. def toJson: JValue

    Definition Classes

    KafkaInput → JsonExport

50. def toXml: Elem

    Definition Classes

    KafkaInput → XmlExport

51. def topics(t: String): KafkaInput

52. def topics(t: String*): KafkaInput

53. val topics: Iterable[String]

54. def unregister(implicit rt: SparkStreamingRuntime): Unit

    Unregisters the step with the runtime.

    Unregisters the step with the runtime. After the restart, the step will no longer be bound to the active context.

    Definition Classes

    StreamStep

55. def value(implicit runtime: SparkStreamingRuntime): DataStream

    Definition Classes

    SingleOutputStep → ConnectionSource

56. final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

57. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

58. final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

59. final def wrap[U](body: ⇒ U): U

    Wraps exceptions into ExecutionException instances.

    Wraps exceptions into ExecutionException instances.

    Attributes

    protected

    Definition Classes

    AbstractStep