interface to implement custom data sink where result of a DAG is typically written
general task that runs any DataSink
utility that helps user to create a DAG ending in DataSink user should pass in a DataSink
utility that helps user to create a DAG ending in DataSink user should pass in a DataSink
here is an example to build a DAG that does word count and write to KafkaSink
val split = Processor[Split](1) val sum = Processor[Sum](1) val sink = new KafkaSink() val sinkProcessor = DataSinkProcessor(sink, 1) val dag = split ~> sum ~> sink
interface to implement custom data sink where result of a DAG is typically written
a DataSink could be a data store like HBase or simply a console
an example would be like
subclass is required to be serializable