Package

io.gearpump.streaming

sink

Permalink

package sink

Visibility

Public
All

Type Members

trait DataSink extends Serializable

interface to implement custom data sink where result of a DAG is typically written
interface to implement custom data sink where result of a DAG is typically written
a DataSink could be a data store like HBase or simply a console
an example would be like
```
class ConsoleSink extends DataSink[String] {

  def open(context: TaskContext): Unit = {}

  def write(s: String): Unit = {
    Console.println(s)
  }

  def close(): Unit = {}
}
```
subclass is required to be serializable
class DataSinkTask extends Task

general task that runs any DataSink

Value Members

object DataSinkProcessor

utility that helps user to create a DAG ending in DataSink user should pass in a DataSink.
utility that helps user to create a DAG ending in DataSink user should pass in a DataSink.
here is an example to build a DAG that does word count and write to KafkaSink
```
val split = Processor[Split](1)
val sum = Processor[Sum](1)
val sink = new KafkaSink()
val sinkProcessor = DataSinkProcessor(sink, 1)
val dag = split ~> sum ~> sink
```
object DataSinkTask

Ungrouped