package partitions
- Alphabetic
- By Inheritance
- partitions
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Type Members
- final case class AppendData[A, K](bucket: K, record: A) extends BatchEvent[A, K] with Product with Serializable
-
sealed
trait
BatchEvent[A, K] extends AnyRef
The data passing through will be partitioned into different buckets.
The data passing through will be partitioned into different buckets. At some point we'll acknowledge that there won't be anymore records coming through for a particular bucket (partition)
- final case class FlushBucket[A, K](bucket: K) extends BatchEvent[A, K] with Product with Serializable
- final case class ForceFlushBuckets[A, K](close: Boolean) extends BatchEvent[A, K] with Product with Serializable
- trait HasTimestamp[A] extends AnyRef
-
final
case class
MiniBatchState[A, K] extends Product with Serializable
State which represents the consumption of 'ConsumerRecords' from kafka and partition them into buckets.
State which represents the consumption of 'ConsumerRecords' from kafka and partition them into buckets.
Each bucket should be represented as an observable of some kind of data structure which contains the ConsumerRecords that completes once we've consumed all* the records from the time bucket (e.g. if we want to partition the data into 10 minute segments, one partition would contain the records from 8:10 to 8:20)
-
trait
Partitioner[A, B] extends AnyRef
A means to place values of type A into buckets of type B
- final case class TimeBucket(hour: Int, fromMinute: Int, toMinute: Int) extends Product with Serializable
Value Members
- val UTC: ZoneId
- def utcForEpochMillis(epochMilli: Long): ZonedDateTime
- object HasTimestamp
- object MiniBatchState extends Serializable
- object Partitioner
- object TimeBucket extends Serializable