Packages

package root

Cassandra connector for Apache Spark.

Cassandra connector for Apache Spark. See documentation of package com.datastax.spark.connector.

Definition Classes: root

package com

Definition Classes: root

package datastax

Definition Classes: com

package spark

Definition Classes: datastax

package connector

The root package of Cassandra connector for Apache Spark.

The root package of Cassandra connector for Apache Spark. Offers handy implicit conversions that add Cassandra-specific methods to SparkContext and RDD.

Call cassandraTable method on the SparkContext object to create a CassandraRDD exposing Cassandra tables as Spark RDDs.

Call RDDFunctions saveToCassandra function on any RDD to save distributed collection to a Cassandra table.

Example:

CREATE KEYSPACE test WITH replication = {'class': 'SimpleStrategy', 'replication_factor': 1 };
CREATE TABLE test.words (word text PRIMARY KEY, count int);
INSERT INTO test.words(word, count) VALUES ("and", 50);

import com.datastax.spark.connector._

val sparkMasterHost = "127.0.0.1"
val cassandraHost = "127.0.0.1"
val keyspace = "test"
val table = "words"

// Tell Spark the address of one Cassandra node:
val conf = new SparkConf(true).set("spark.cassandra.connection.host", cassandraHost)

// Connect to the Spark cluster:
val sc = new SparkContext("spark://" + sparkMasterHost + ":7077", "example", conf)

// Read the table and print its contents:
val rdd = sc.cassandraTable(keyspace, table)
rdd.toArray().foreach(println)

// Write two rows to the table:
val col = sc.parallelize(Seq(("of", 1200), ("the", "863")))
col.saveToCassandra(keyspace, table)

sc.stop()

Definition Classes: spark

package cql

Contains a cql.CassandraConnector object which is used to connect to a Cassandra cluster and to send CQL statements to it.

Contains a cql.CassandraConnector object which is used to connect to a Cassandra cluster and to send CQL statements to it. CassandraConnector provides a Scala-idiomatic way of working with Cluster and Session object and takes care of connection pooling and proper resource disposal.

Definition Classes: connector

package japi

Definition Classes: connector

package rdd

CassandraJavaUtil

CassandraRow

CassandraStreamingJavaUtil

DStreamJavaFunctions

GenericJavaRowReaderFactory

JavaGettableByIndexData

JavaGettableData

PairRDDJavaFunctions

RDDAndDStreamCommonJavaFunctions

RDDJavaFunctions

SparkContextJavaFunctions

StreamingContextJavaFunctions

TupleValue

UDTValue

package mapper

Provides machinery for mapping Cassandra tables to user defined Scala classes or tuples.

Provides machinery for mapping Cassandra tables to user defined Scala classes or tuples. The main class in this package is mapper.ColumnMapper responsible for matching Scala object's properties with Cassandra column names.

Definition Classes: connector

package rdd

Contains com.datastax.spark.connector.rdd.CassandraTableScanRDD class that is the main entry point for analyzing Cassandra data from Spark.

Definition Classes: connector

package streaming

Definition Classes: connector

package types

Offers type conversion magic, so you can receive Cassandra column values in a form you like the most.

Offers type conversion magic, so you can receive Cassandra column values in a form you like the most. Simply specify the type you want to use on the Scala side, and the column value will be converted automatically. Works also with complex objects like collections.

Definition Classes: connector

package util

Useful stuff that didn't fit elsewhere.

Definition Classes: connector

package writer

Contains components for writing RDDs to Cassandra

Definition Classes: connector

com.datastax.spark.connector

japi

package japi

Ordering

Alphabetic

Visibility

Public
All

Type Members

class CassandraJavaUtil extends AnyRef
The main entry point to Spark Cassandra Connector Java API.
The main entry point to Spark Cassandra Connector Java API.
There are several helpful static factory methods which build useful wrappers around Spark Context, and RDD. There are also helper methods to build reader and writer factories which configure their parameters.
final class CassandraRow extends JavaGettableData with Serializable
class CassandraStreamingJavaUtil extends AnyRef
The main entry point to Spark Cassandra Connector Java API for Spark Streaming.
The main entry point to Spark Cassandra Connector Java API for Spark Streaming.
There are several helpful static factory methods which build useful wrappers around Streaming Context and DStream.
class DStreamJavaFunctions[T] extends RDDAndDStreamCommonJavaFunctions[T]
A Java API wrapper over DStream to provide Spark Cassandra Connector functionality.
A Java API wrapper over DStream to provide Spark Cassandra Connector functionality.
To obtain an instance of this wrapper, use one of the factory methods in CassandraJavaUtil class.
class GenericJavaRowReaderFactory extends AnyRef
trait JavaGettableByIndexData extends GettableByIndexData
trait JavaGettableData extends JavaGettableByIndexData with GettableData
class PairRDDJavaFunctions[K, V] extends RDDJavaFunctions[(K, V)]
abstract class RDDAndDStreamCommonJavaFunctions[T] extends AnyRef
Java API wrapper over either RDD or DStream to provide Spark Cassandra Connector functionality.
Java API wrapper over either RDD or DStream to provide Spark Cassandra Connector functionality.
To obtain an instance of the specific wrapper, use one of the factory methods in com.datastax.spark.connector.japi.CassandraJavaUtil class.
class RDDJavaFunctions[T] extends RDDAndDStreamCommonJavaFunctions[T]
A Java API wrapper over RDD to provide Spark Cassandra Connector functionality.
A Java API wrapper over RDD to provide Spark Cassandra Connector functionality.
To obtain an instance of this wrapper, use one of the factory methods in CassandraJavaUtil class.
class SparkContextJavaFunctions extends AnyRef
Java API wrapper over org.apache.spark.SparkContext to provide Spark Cassandra Connector functionality.
Java API wrapper over org.apache.spark.SparkContext to provide Spark Cassandra Connector functionality.
To obtain an instance of this wrapper, use one of the factory methods in com.datastax.spark.connector.japi.CassandraJavaUtil class.
class StreamingContextJavaFunctions extends SparkContextJavaFunctions
Java API wrapper over org.apache.spark.streaming.StreamingContext to provide Spark Cassandra Connector functionality.
Java API wrapper over org.apache.spark.streaming.StreamingContext to provide Spark Cassandra Connector functionality.
To obtain an instance of this wrapper, use one of the factory methods in com.datastax.spark.connector.japi.CassandraJavaUtil class.
final class TupleValue extends JavaGettableByIndexData with Serializable
final class UDTValue extends JavaGettableData with Serializable

Value Members

object CassandraRow extends Serializable
object TupleValue extends Serializable
object UDTValue extends Serializable

Packages

japi 

package japi

Type Members

Value Members

Ungrouped

japi