Packages

p

kafka4m

package kafka4m

The high-level API space for kafka consumers

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. kafka4m
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. type Bytes = Array[Byte]
  2. type Key = String
  3. type KeyValue = (Key, Bytes)

Value Members

  1. def ensureTopicBlocking(config: Config)(implicit ec: ExecutionContext): Option[String]

    Kafka Streams will fail if the topic does not yet exist.

    Kafka Streams will fail if the topic does not yet exist. This way we can provide a means to 'getOrCreate' a topic if that's how it's configured.

  2. def read(config: Config): Observable[ConsumerRecord[Key, Bytes]]

    config

    the kafka4m configuration which contains the 'kafka4m.consumer' values

    returns

    an Observable of data coming from kafka. The offsets, etc will be controlled by the kafka4m.consumer configuration, which includes default offset strategy, etc.

  3. def write[A](config: Config)(implicit arg0: AsProducerRecord[A]): Consumer[A, Long]

    A

    any type A which can be converted into a kafka ProducerRecord

    config

    the kafka4m configuration

    returns

    a consumer of the 'A' values and produce the number written

  4. def writeKeyAndBytes(config: Config = ConfigFactory.load()): Consumer[(String, Array[Byte]), Long]

    config

    the kafka4m configuration

    returns

    a consumer which will consume a stream of key/byte-array values into kafka and return the number written

  5. def writeText(config: Config = ConfigFactory.load()): Consumer[String, Long]

    config

    the kafka4m configuration

    returns

    a consumer which will consume raw text data and write it with null keys

  6. object Kafka4mApp extends ConfigApp with StrictLogging

    An ETL entry point to read data into or out of kafka

Inherited from AnyRef

Inherited from Any

Ungrouped