:: Experimental :: Java constructor for a DStream where each given Kafka topic/partition corresponds to an RDD partition.
:: Experimental :: Java constructor for a DStream where each given Kafka topic/partition corresponds to an RDD partition.
type of Kafka message key
type of Kafka message value
In most cases, pass in LocationStrategies.PreferConsistent, see LocationStrategies for more details.
In most cases, pass in ConsumerStrategies.Subscribe, see ConsumerStrategies for more details
configuration of settings such as max rate on a per-partition basis. see PerPartitionConfig for more details.
:: Experimental :: Java constructor for a DStream where each given Kafka topic/partition corresponds to an RDD partition.
:: Experimental :: Java constructor for a DStream where each given Kafka topic/partition corresponds to an RDD partition.
type of Kafka message key
type of Kafka message value
In most cases, pass in LocationStrategies.PreferConsistent, see LocationStrategies for more details.
In most cases, pass in ConsumerStrategies.Subscribe, see ConsumerStrategies for more details
:: Experimental :: Scala constructor for a DStream where each given Kafka topic/partition corresponds to an RDD partition.
:: Experimental :: Scala constructor for a DStream where each given Kafka topic/partition corresponds to an RDD partition.
type of Kafka message key
type of Kafka message value
In most cases, pass in LocationStrategies.PreferConsistent, see LocationStrategies for more details.
In most cases, pass in ConsumerStrategies.Subscribe, see ConsumerStrategies for more details.
configuration of settings such as max rate on a per-partition basis. see PerPartitionConfig for more details.
:: Experimental :: Scala constructor for a DStream where each given Kafka topic/partition corresponds to an RDD partition.
:: Experimental :: Scala constructor for a DStream where each given Kafka topic/partition corresponds to an RDD partition. The spark configuration spark.streaming.kafka.maxRatePerPartition gives the maximum number of messages per second that each partition will accept.
type of Kafka message key
type of Kafka message value
In most cases, pass in LocationStrategies.PreferConsistent, see LocationStrategies for more details.
In most cases, pass in ConsumerStrategies.Subscribe, see ConsumerStrategies for more details
:: Experimental :: Java constructor for a batch-oriented interface for consuming from Kafka.
:: Experimental :: Java constructor for a batch-oriented interface for consuming from Kafka. Starting and ending offsets are specified in advance, so that you can control exactly-once semantics.
type of Kafka message key
type of Kafka message value
Kafka configuration parameters. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.
offset ranges that define the Kafka data belonging to this RDD
In most cases, pass in LocationStrategies.PreferConsistent, see LocationStrategies for more details.
:: Experimental :: Scala constructor for a batch-oriented interface for consuming from Kafka.
:: Experimental :: Scala constructor for a batch-oriented interface for consuming from Kafka. Starting and ending offsets are specified in advance, so that you can control exactly-once semantics.
type of Kafka message key
type of Kafka message value
Kafka configuration parameters. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.
offset ranges that define the Kafka data belonging to this RDD
In most cases, pass in LocationStrategies.PreferConsistent, see LocationStrategies for more details.
:: Experimental :: object for constructing Kafka streams and RDDs