com.datastax.spark.connector

Class DStreamJavaFunctions<T>

java.lang.Object

com.datastax.spark.connector.RDDAndDStreamCommonJavaFunctions<T>

com.datastax.spark.connector.DStreamJavaFunctions<T>

public class DStreamJavaFunctions<T>
extends RDDAndDStreamCommonJavaFunctions<T>

Field Summary

Fields

Modifier and Type	Field and Description
org.apache.spark.streaming.dstream.DStream<T>	rdd

Method Summary

Methods

Modifier and Type	Method and Description
void	saveToCassandra(java.lang.String keyspace, java.lang.String table, com.datastax.spark.connector.writer.RowWriterFactory<T> rowWriterFactory) Saves the data from the underlying RDD or DStream to a Cassandra table.
void	saveToCassandra(java.lang.String keyspace, java.lang.String table, java.lang.String[] columnNames, int batchSize, com.datastax.spark.connector.writer.RowWriterFactory<T> rowWriterFactory) Saves the data from the underlying RDD or DStream to a Cassandra table in batches of given size.
void	saveToCassandra(java.lang.String keyspace, java.lang.String table, java.lang.String[] columnNames, com.datastax.spark.connector.writer.RowWriterFactory<T> rowWriterFactory) Saves the data from the underlying RDD or DStream to a Cassandra table.

Methods inherited from class com.datastax.spark.connector.RDDAndDStreamCommonJavaFunctions

saveToCassandra, saveToCassandra, saveToCassandra, saveToCassandra, saveToCassandra, saveToCassandra, saveToCassandra, saveToCassandra, saveToCassandra

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

rdd

public final org.apache.spark.streaming.dstream.DStream<T> rdd

Method Detail

saveToCassandra

public void saveToCassandra(java.lang.String keyspace,
                   java.lang.String table,
                   com.datastax.spark.connector.writer.RowWriterFactory<T> rowWriterFactory)

Description copied from class: RDDAndDStreamCommonJavaFunctions

Saves the data from the underlying RDD or DStream to a Cassandra table. This method works just like RDDAndDStreamCommonJavaFunctions.saveToCassandra(String, String). It additionally allows the specification of a factory of custom RowWriter. By default, a factory of DefaultRowWriter is used together with an underlying JavaBeanColumnMapper.

If the underlying data source is a DStream, all generated RDDs will be saved to Cassandra as if this method was called on each of them.

Specified by:

saveToCassandra in class RDDAndDStreamCommonJavaFunctions<T>

See Also:

RDDAndDStreamCommonJavaFunctions.saveToCassandra(String, String)

saveToCassandra

public void saveToCassandra(java.lang.String keyspace,
                   java.lang.String table,
                   java.lang.String[] columnNames,
                   com.datastax.spark.connector.writer.RowWriterFactory<T> rowWriterFactory)

Description copied from class: RDDAndDStreamCommonJavaFunctions

Saves the data from the underlying RDD or DStream to a Cassandra table. This method works just like RDDAndDStreamCommonJavaFunctions.saveToCassandra(String, String, String[]). It additionally allows the specification of a factory of custom RowWriter. By default, a factory of DefaultRowWriter is used together with an underlying JavaBeanColumnMapper.

If the underlying data source is a DStream, all generated RDDs will be saved to Cassandra as if this method was called on each of them.

Specified by:

saveToCassandra in class RDDAndDStreamCommonJavaFunctions<T>

See Also:

RDDAndDStreamCommonJavaFunctions.saveToCassandra(String, String, String[])

saveToCassandra

public void saveToCassandra(java.lang.String keyspace,
                   java.lang.String table,
                   java.lang.String[] columnNames,
                   int batchSize,
                   com.datastax.spark.connector.writer.RowWriterFactory<T> rowWriterFactory)

Description copied from class: RDDAndDStreamCommonJavaFunctions

Saves the data from the underlying RDD or DStream to a Cassandra table in batches of given size. This method works just like RDDAndDStreamCommonJavaFunctions.saveToCassandra(String, String, String[], int). It additionally allows the specification of a factory of custom RowWriter. By default, a factory of DefaultRowWriter is used together with an underlying JavaBeanColumnMapper.

If the underlying data source is a DStream, all generated RDDs will be saved to Cassandra as if this method was called on each of them.

Specified by:

saveToCassandra in class RDDAndDStreamCommonJavaFunctions<T>

See Also:

RDDAndDStreamCommonJavaFunctions.saveToCassandra(String, String, String[], int)