Class

io.github.interestinglab.waterdrop.output.structuredstreaming

Kafka

Related Doc: package structuredstreaming

Permalink

class Kafka extends ForeachWriter[Row] with BaseStructuredStreamingOutput

Linear Supertypes
BaseStructuredStreamingOutput, BaseStructuredStreamingOutputIntra, Plugin, Logging, ForeachWriter[Row], Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Kafka
  2. BaseStructuredStreamingOutput
  3. BaseStructuredStreamingOutputIntra
  4. Plugin
  5. Logging
  6. ForeachWriter
  7. Serializable
  8. Serializable
  9. AnyRef
  10. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new Kafka()

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def checkConfig(): (Boolean, String)

    Permalink
    Definition Classes
    Kafka → Plugin

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  7. def close(errorOrNull: Throwable): Unit

    Permalink

    Things to do after process.

    Things to do after process.

    Definition Classes
    Kafka → BaseStructuredStreamingOutput → ForeachWriter

  8. var config: Config

    Permalink

  9. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  10. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  11. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  12. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  13. def getConfig(): Config

    Permalink
    Definition Classes
    Kafka → Plugin

  14. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  15. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  16. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  17. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  18. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  19. var kafkaSink: Broadcast[KafkaProducerUtil]

    Permalink

  20. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  21. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  22. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  23. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  24. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  25. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  26. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  27. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  28. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  29. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  30. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  31. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  32. def name: String

    Permalink
    Definition Classes
    Plugin

  33. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  34. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  35. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  36. def open(partitionId: Long, epochId: Long): Boolean

    Permalink

    Things to do before process.

    Things to do before process.

    Definition Classes
    Kafka → BaseStructuredStreamingOutput → ForeachWriter

  37. var options: HashMap[String, String]

    Permalink

  38. val outConfPrefix: String

    Permalink

  39. def prepare(spark: SparkSession): Unit

    Permalink
    Definition Classes
    Kafka → Plugin

  40. def process(df: Dataset[Row]): DataStreamWriter[Row]

    Permalink

    Waterdrop Structured Streaming process.

    Waterdrop Structured Streaming process.

    Definition Classes
    Kafka → BaseStructuredStreamingOutput → BaseStructuredStreamingOutputIntra

  41. def process(row: Row): Unit

    Permalink

    Things to do with each Row.

    Things to do with each Row.

    Definition Classes
    Kafka → BaseStructuredStreamingOutput → ForeachWriter

  42. val producerPrefix: String

    Permalink

  43. def setConfig(config: Config): Unit

    Permalink
    Definition Classes
    Kafka → Plugin

  44. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  45. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  46. var topic: String

    Permalink

  47. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  48. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  49. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from BaseStructuredStreamingOutput

Inherited from BaseStructuredStreamingOutputIntra

Inherited from Plugin

Inherited from Logging

Inherited from ForeachWriter[Row]

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped