CassandraSCollection

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   Any

2. final def ##(): Int

   

   Definition Classes

   Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def getClass(): Class[_ <: AnyVal]

   

   Definition Classes

   AnyVal → Any

6. final def isInstanceOf[T0]: Boolean

   

   Definition Classes

   Any

7. def saveAsCassandra(opts: CassandraOptions, parallelism: Int = CassandraIO.WriteParam.DefaultPar)(f: (T) ⇒ Seq[Any])(implicit coder: Coder[T]): Future[Tap[Nothing]]

   

   Save this SCollection as a Cassandra table.

   Save this SCollection as a Cassandra table.

   Cassandra org.apache.cassandra.hadoop.cql3.CqlBulkRecordWriter is used to perform bulk writes for better throughput. The SCollection is grouped by the table partition key before written to the cluster. Therefore writes only occur at the end of each window in streaming mode. The bulk writer writes to all nodes in a cluster so remote nodes in a multi-datacenter cluster may become a bottleneck.

   NOTE: this module is optimized for throughput in batch mode and not recommended for streaming mode.

   opts

   Cassandra options

   parallelism

   number of concurrent bulk writers, default to number of Cassandra nodes

   f

   function to convert input data to values for the CQL statement

8. def toString(): String

   

   Definition Classes

   Any