io

Ordering

Visibility

trait Appender[A] extends AutoCloseable
Represents a sink for writing values to some persistent source
case class Base64Writer[A](dir: Path, recordsReceivedBeforeClosingBucket: Int, numberOfAppendsBeforeWriterFlush: Int, timeBucketMinutes: Int, flushEvery: Int, limit: Option[Long])(implicit evidence$1: HasTimestamp[A], evidence$2: Show[A]) extends Product with Serializable
An ETL configuration which will take Kafka records and write them to some directory
An ETL configuration which will take Kafka records and write them to some directory
A
the record type
dir
the directory to write the buckets under
recordsReceivedBeforeClosingBucket
see comments in reference.conf
numberOfAppendsBeforeWriterFlush
see comments in reference.conf
timeBucketMinutes
see comments in reference.conf
class TextAppenderObserver[A] extends Observer[A] with Appender[A] with StrictLogging
class ZipAppenderObserver[A] extends Observer[A] with Appender[A] with AutoCloseable with StrictLogging

object Base64Writer extends StrictLogging with Serializable
object FileSink
Means to write data to zips
object FileSource
A means to get a stream of data from a directory, if only to make kafka4m useful out-of-the-box.
A means to get a stream of data from a directory, if only to make kafka4m useful out-of-the-box.
This way we can get a stream of data from each file
object TextAppenderObserver extends Serializable
A namespace which holds a 'fromEvents' as a means to transform append events into time-bucketed files
object ZipAppenderObserver extends Serializable

Packages