writer

Type Members

1. class AsyncExecutor[T, R] extends Logging

   

   Asynchronously executes tasks but blocks if the limit of unfinished tasks is reached.

2. sealed trait BatchGroupingKey extends AnyRef

   

3. class CassandraRowWriter extends RowWriter[CassandraRow]

   

   A RowWriter that can write CassandraRow objects.

4. class DefaultRowWriter[T] extends RowWriter[T]

   

   A RowWriter suitable for saving objects mappable by a ColumnMapper.

   A RowWriter suitable for saving objects mappable by a ColumnMapper. Can save case class objects, java beans and tuples.

5. trait LowPriorityRowWriterFactoryImplicits extends AnyRef

   

   Provides a low-priority implicit RowWriterFactory able to write objects of any class for which a ColumnMapper is defined.

6. case class PerRowWriteOptionValue[T](placeholder: String) extends WriteOptionValue[T] with Product with Serializable

   

7. class PropertyExtractor[T] extends Serializable

   

   Extracts values from fields of an object.

8. class QueryExecutor extends AsyncExecutor[RichStatement, ResultSet]

   

9. class RateLimiter extends AnyRef

   

   A leaking bucket rate limiter.

   A leaking bucket rate limiter. It can be used to limit rate of anything, but typically it is used to limit rate of data transfer.

   It starts with an empty bucket. When packets arrive, they are added to the bucket. The bucket has a constant size and is leaking at a constant rate. If the bucket overflows, the thread is delayed by the amount of time proportional to the amount of the overflow.

   This class is thread safe and lockless.

10. class ReplicaMapper[T] extends Serializable with Logging

    

    A utility class for determining the Replica Set (Ip Addresses) of a particular Cassandra Row.

    A utility class for determining the Replica Set (Ip Addresses) of a particular Cassandra Row. Used by the com.datastax.spark.connector.RDDFunctions.keyByCassandraReplica method. Uses the Java Driver to obtain replica information.

11. trait RichStatement extends AnyRef

    

12. class RoutingKeyGenerator extends (BoundStatement) ⇒ ByteBuffer

    

    This class computes the routing key of a bound statement.

13. trait RowWriter[T] extends Serializable

    

    RowWriter knows how to extract column names and values from custom row objects and how to convert them to values that can be written to Cassandra.

    RowWriter knows how to extract column names and values from custom row objects and how to convert them to values that can be written to Cassandra. RowWriter is required to apply any user-defined data type conversion.

14. trait RowWriterFactory[T] extends AnyRef

    

    Creates instances of RowWriter objects for the given row type T.

    Creates instances of RowWriter objects for the given row type T. RowWriterFactory is the trait you need to implement if you want to support row representations which cannot be simply mapped by a ColumnMapper.

15. class SqlRowWriter extends RowWriter[Row]

    

    A RowWriter that can write SparkSQL Row objects.

16. case class StaticWriteOptionValue[T](value: T) extends WriteOptionValue[T] with Product with Serializable

    

17. case class TTLOption(value: WriteOptionValue[Int]) extends WriteOption[Int] with Product with Serializable

    

18. class TableWriter[T] extends Serializable with Logging

    

    Writes RDD data into given Cassandra table.

    Writes RDD data into given Cassandra table. Individual column values are extracted from RDD objects using given RowWriter Then, data are inserted into Cassandra with batches of CQL INSERT statements. Each RDD partition is processed by a single thread.

19. case class TimestampOption(value: WriteOptionValue[Long]) extends WriteOption[Long] with Product with Serializable

    

20. abstract class WritableToCassandra[T] extends AnyRef

    

21. case class WriteConf(batchSize: BatchSize = BatchSize.Automatic, batchGroupingBufferSize: Int = ..., batchGroupingKey: BatchGroupingKey = WriteConf.DefaultBatchGroupingKey, consistencyLevel: ConsistencyLevel = WriteConf.DefaultConsistencyLevel, parallelismLevel: Int = WriteConf.DefaultParallelismLevel, throughputMiBPS: Int = WriteConf.DefaultThroughputMiBPS, ttl: TTLOption = TTLOption.defaultValue, timestamp: TimestampOption = TimestampOption.defaultValue, taskMetricsEnabled: Boolean = ...) extends Product with Serializable

    

    Write settings for RDD

    Write settings for RDD

    batchSize

    approx. number of bytes to be written in a single batch or exact number of rows to be written in a single batch;

    batchGroupingBufferSize

    the number of distinct batches that can be buffered before they are written to Cassandra

    batchGroupingKey

    which rows can be grouped into a single batch

    consistencyLevel

    consistency level for writes, default LOCAL_ONE

    parallelismLevel

    number of batches to be written in parallel

    ttl

    the default TTL value which is used when it is defined (in seconds)

    timestamp

    the default timestamp value which is used when it is defined (in microseconds)

    taskMetricsEnabled

    whether or not enable task metrics updates (requires Spark 1.2+)

22. sealed trait WriteOption[+T] extends AnyRef

    

23. sealed trait WriteOptionValue[+T] extends AnyRef