Package

org.apache.spark.streaming

eventhubs

Permalink

package eventhubs

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. eventhubs
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. case class DfsBasedOffsetStore(filePath: Path) extends OffsetStore with Logging with Product with Serializable

    Permalink

    An DFS based OffsetStore implementation

  2. case class EventHubsClientWrapper(receiver: ResilientEventHubReceiver, filter: Option[IEventHubFilter], waitTimeInMilliseconds: Long) extends Product with Serializable

    Permalink
  3. trait EventHubsParameters extends Serializable

    Permalink

    EventHubs parameters.

    EventHubs parameters.

    policyName "eventhubs.policyname": EventHubs policy name. Mandatory. policyKey "eventhubs.policykey": EventHubs policy key. Mandatory. namespace "eventhubs.namespace": EventHubs namespace. Mandatory. name "eventhubs.name": EventHubs name. Mandatory. partitionCount "eventhubs.partition.count": Number of partitions. Mandatory. consumerGroup "eventhubs.consumergroup": EventHubs consumer group name, default to "$default" defaultAMQPCredits "eventhubs.default.credits": default AMQP credits, default to -1 (which is 1024)

  4. class EventHubsRDD extends RDD[EventHubMessage] with Logging

    Permalink
  5. trait EventHubsStreamingParameters extends EventHubsParameters

    Permalink

    EventHubs Streaming parameters.

    EventHubs Streaming parameters.

    filter Two options: "eventhubs.filter.offset", starting offset of EventHubs, default to "-1" or filterEnqueueTime ("eventhubs.filter.enqueuetime"), unix time, millisecond since epoch, default to "0" offsetDir "eventhubs.offsets.dir": checkpoint directory on HDFS. Mandatory. checkpointInterval "eventhubs.checkpoint.interval": checkpoint interval in seconds, default to 10

  6. case class FilterEnqueueTime(value: Long) extends FilterType with Product with Serializable

    Permalink
  7. case class FilterOffset(value: Long) extends FilterType with Product with Serializable

    Permalink
  8. sealed trait FilterType extends AnyRef

    Permalink
  9. trait OffsetStore extends Serializable

    Permalink

    An interface to read/write offset for a given EventHubs namespace/name/partition

    An interface to read/write offset for a given EventHubs namespace/name/partition

    Annotations
    @SerialVersionUID()
  10. final class PartitionOffset extends Serializable

    Permalink

    Represents the offset for a single EventHubs Partition.

Value Members

  1. object DfsBasedOffsetStore extends Serializable

    Permalink
  2. object EventHubsClientWrapper extends Serializable

    Permalink
  3. object EventHubsParameters extends Serializable

    Permalink
  4. object EventHubsStreamingParameters extends Serializable

    Permalink
  5. object EventHubsUtils

    Permalink
  6. object PartitionOffset extends Serializable

    Permalink
  7. object ThreadUtils

    Permalink
  8. val defaultAMQPCredits: Int

    Permalink
  9. val defaultCheckpointInterval: Int

    Permalink
  10. val defaultConsumerGroup: String

    Permalink
  11. val defaultFilter: Option[FilterType]

    Permalink
  12. val defaultWaitTimeInMilliseconds: Long

    Permalink
  13. def getOffsetFilter(ehParams: EventHubsStreamingParameters, offsetStore: Option[OffsetStore]): Option[IEventHubFilter]

    Permalink
  14. def getOffsetFilter(ehParams: EventHubsStreamingParameters, partitionId: String): Option[IEventHubFilter]

    Permalink
  15. def getOffsetStoreByPartitionId(eventHubsParams: EventHubsStreamingParameters, partitionId: String): Option[OffsetStore]

    Permalink

    Creates an offset store if the provided offset directory has been specified.

    Creates an offset store if the provided offset directory has been specified.

    returns

    OffsetStore if proceeds.

Inherited from AnyRef

Inherited from Any

Ungrouped