Package

com.acxiom.pipeline

drivers

Permalink

package drivers

Visibility
  1. Public
  2. All

Value Members

  1. object KafkaPipelineDriver

    Permalink

    Provides a driver that listens to a kafka cluster and one or more topics.

    Provides a driver that listens to a kafka cluster and one or more topics.

    Required parameters:

    "driverSetupClass" - This class will handle all of the initial setup such as building out pipelines, creating the PipelineContext. "topics" - a comma separated list of topics to monitor "kafkaNodes" - a comma separated list of Kafka brokers to consume data

    Optional Parameters:

    "duration-type" - should be seconds or minutes "duration" - should be a number "groupId" - should be a string "terminationPeriod" - This is a number (ms) that informs the system to run for the specified amount of time and then shut down.

  2. object KinesisPipelineDriver

    Permalink

    Provides a driver that listens to a kafka cluster and one or more topics.

    Provides a driver that listens to a kafka cluster and one or more topics.

    Required parameters:

    "driverSetupClass" - This class will handle all of the initial setup such as building out pipelines, creating the PipelineContext. "appName" - The name of this app to use when check pointing Kinesis sequence numbers. "streamName" - The Kinesis stream where data will be pulled "endPointURL" - The Kinesis URL where to connect the app. "regionName" - A valid AWS region "awsAccessKey" - The AWS access key used to connect "awsAccessSecret" - The AWS access secret used to connect

    Optional Parameters:

    "duration-type" - should be seconds or minutes "duration" - should be a number "terminationPeriod" - This is a number (ms) that informs the system to run for the specified amount of time and then shut down.

Ungrouped