Type Members

1.  final case class Append(topicPartition: TopicPartition, offset: Long, bytes: Array[Byte]) extends BatchEvent with Product with Serializable
2.  sealed trait BatchEvent extends AnyRef

   An input event to something which builds up a zip file

3.  trait BatchEventHandler extends AnyRef

   Represents a buffer which can be folded over to produce a BatchEventHandler.UpdateResult

4.  case class TopicBatch[A](content: A, topicPartition: TopicPartition, minOffset: Long, maxOffset: Long) extends Product with Serializable

   Represents a range of data encapsulated in the type 'A' (typically a file path, byte array, etc)

   Represents a range of data encapsulated in the type 'A' (typically a file path, byte array, etc)

   content

   could be an array of bytes, ByteBuffer, path to a zip file, etc

5.  case class TopicBatchSettings(rootConfig: Config, formatter: ValueFormatter, maxSizeInBytes: Long, flushFrequency: FiniteDuration, kafka: SinkPipe, logRate: Boolean, handlerForPartition: (TopicPartition) ⇒ BatchEventHandler) extends Product with Serializable

   The parsed configuration for the TopicBatch

   The parsed configuration for the TopicBatch

   rootConfig

   the configuration the SinkProcess was initialised with

   formatter

   a means of converting SinkRecords into byte arrays

   maxSizeInBytes

   how many bytes we should append before flushing a TopicBatch

   flushFrequency

   how often the TopicBatches should be created should we not be appending enough data to satisfy the 'maxSizeInBytes'

   kafka

   a handle to the kafka events

   logRate

   flag to indicate that the messages per second should be logged periodically

   handlerForPartition

   a means to create a new buffer (BatchEventHandler) for a particular topic

6.  final class TopicBatchSinkProcess extends SinkProcess

   A sink process which writes entries to a zip file