Producer
Akka Stream connector for publishing messages to Kafka topics.
Attributes
- Source:
- Producer.scala
- Graph
- Supertypes
- Self type
- Producer.type
Members list
Value members
Concrete methods
Create a sink that is aware of the committable offset from a Consumer.committableSource. The offsets are batched and committed regularly.
Create a sink that is aware of the committable offset from a Consumer.committableSource. The offsets are batched and committed regularly.
It publishes records to Kafka topics conditionally:
-
Message publishes a single message to its topic, and commits the offset
-
MultiMessage publishes all messages in its
records
field, and commits the offset -
PassThroughMessage does not publish anything, but commits the offset
Note that there is a risk that something fails after publishing but before committing, so it is "at-least once delivery" semantics.
Attributes
- Source:
- Producer.scala
Create a sink that is aware of the committable offset passed as context from a Consumer.sourceWithOffsetContext. The offsets are batched and committed regularly.
Create a sink that is aware of the committable offset passed as context from a Consumer.sourceWithOffsetContext. The offsets are batched and committed regularly.
It publishes records to Kafka topics conditionally:
-
Message publishes a single message to its topic, and commits the offset
-
MultiMessage publishes all messages in its
records
field, and commits the offset -
PassThroughMessage does not publish anything, but commits the offset
Note that there is a risk that something fails after publishing but before committing, so it is "at-least once delivery" semantics.
Attributes
- Source:
- Producer.scala
Create a flow to conditionally publish records to Kafka topics and then pass it on.
Create a flow to conditionally publish records to Kafka topics and then pass it on.
It publishes records to Kafka topics conditionally:
-
Message publishes a single message to its topic, and continues in the stream as Result
-
MultiMessage publishes all messages in its
records
field, and continues in the stream as MultiResult -
PassThroughMessage does not publish anything, and continues in the stream as PassThroughResult
The messages support the possibility to pass through arbitrary data, which can for example be a CommittableOffset or CommittableOffsetBatch that can be committed later in the flow.
Attributes
- Source:
- Producer.scala
API MAY CHANGE
API MAY CHANGE
Create a flow to conditionally publish records to Kafka topics and then pass it on.
It publishes records to Kafka topics conditionally:
-
Message publishes a single message to its topic, and continues in the stream as Result
-
MultiMessage publishes all messages in its
records
field, and continues in the stream as MultiResult -
PassThroughMessage does not publish anything, and continues in the stream as PassThroughResult
This flow is intended to be used with Akka's flow with context.
Attributes
- C
the flow context type
- Source:
- Producer.scala
Create a sink for publishing records to Kafka topics.
Create a sink for publishing records to Kafka topics.
The Kafka ProducerRecord contains the topic name to which the record is being sent, an optional partition number, and an optional key and value.
Attributes
- Source:
- Producer.scala
Deprecated methods
Create a sink that is aware of the committable offset from a Consumer.committableSource. It will commit the consumer offset when the message has been published successfully to the topic.
Create a sink that is aware of the committable offset from a Consumer.committableSource. It will commit the consumer offset when the message has been published successfully to the topic.
It publishes records to Kafka topics conditionally:
-
Message publishes a single message to its topic, and commits the offset
-
MultiMessage publishes all messages in its
records
field, and commits the offset -
PassThroughMessage does not publish anything, but commits the offset
Note that there is a risk that something fails after publishing but before committing, so it is "at-least once delivery" semantics.
Attributes
- Deprecated
use
committableSink(ProducerSettings, CommitterSettings)
instead, since 2.0.0- Source:
- Producer.scala
Create a sink that is aware of the committable offset from a Consumer.committableSource. It will commit the consumer offset when the message has been published successfully to the topic.
Create a sink that is aware of the committable offset from a Consumer.committableSource. It will commit the consumer offset when the message has been published successfully to the topic.
It publishes records to Kafka topics conditionally:
-
Message publishes a single message to its topic, and commits the offset
-
MultiMessage publishes all messages in its
records
field, and commits the offset -
PassThroughMessage does not publish anything, but commits the offset
Note that there is always a risk that something fails after publishing but before committing, so it is "at-least once delivery" semantics.
Supports sharing a Kafka Producer instance.
Attributes
- Deprecated
use
committableSink(ProducerSettings, CommitterSettings)
instead, since 2.0.0- Source:
- Producer.scala
Create a flow to conditionally publish records to Kafka topics and then pass it on.
Create a flow to conditionally publish records to Kafka topics and then pass it on.
It publishes records to Kafka topics conditionally:
-
Message publishes a single message to its topic, and continues in the stream as Result
-
MultiMessage publishes all messages in its
records
field, and continues in the stream as MultiResult -
PassThroughMessage does not publish anything, and continues in the stream as PassThroughResult
The messages support the possibility to pass through arbitrary data, which can for example be a CommittableOffset or CommittableOffsetBatch that can be committed later in the flow.
Supports sharing a Kafka Producer instance.
Attributes
- Deprecated
Pass in external or shared producer using
ProducerSettings.withProducerFactory
orProducerSettings.withProducer
, since 2.0.0- Source:
- Producer.scala
Create a flow to publish records to Kafka topics and then pass it on.
Create a flow to publish records to Kafka topics and then pass it on.
The records must be wrapped in a Message and continue in the stream as Result.
The messages support the possibility to pass through arbitrary data, which can for example be a CommittableOffset or CommittableOffsetBatch that can be committed later in the flow.
Attributes
- Deprecated
use
flexiFlow
instead, since 0.21- Source:
- Producer.scala
Create a flow to publish records to Kafka topics and then pass it on.
Create a flow to publish records to Kafka topics and then pass it on.
The records must be wrapped in a Message and continue in the stream as Result.
The messages support the possibility to pass through arbitrary data, which can for example be a CommittableOffset or CommittableOffsetBatch that can be committed later in the flow.
Supports sharing a Kafka Producer instance.
Attributes
- Deprecated
use
flexiFlow
instead, since 0.21- Source:
- Producer.scala
API MAY CHANGE
API MAY CHANGE
Create a flow to conditionally publish records to Kafka topics and then pass it on.
It publishes records to Kafka topics conditionally:
-
Message publishes a single message to its topic, and continues in the stream as Result
-
MultiMessage publishes all messages in its
records
field, and continues in the stream as MultiResult -
PassThroughMessage does not publish anything, and continues in the stream as PassThroughResult
This flow is intended to be used with Akka's flow with context.
Supports sharing a Kafka Producer instance.
Attributes
- C
the flow context type
- Deprecated
Pass in external or shared producer using
ProducerSettings.withProducerFactory
orProducerSettings.withProducer
, since 2.0.0- Source:
- Producer.scala
Create a sink for publishing records to Kafka topics.
Create a sink for publishing records to Kafka topics.
The Kafka ProducerRecord contains the topic name to which the record is being sent, an optional partition number, and an optional key and value.
Supports sharing a Kafka Producer instance.
Attributes
- Deprecated
Pass in external or shared producer using
ProducerSettings.withProducerFactory
orProducerSettings.withProducer
, since 2.0.0- Source:
- Producer.scala