Packages

  • package root

    Cassandra connector for Apache Spark.

    Cassandra connector for Apache Spark. See documentation of package com.datastax.spark.connector.

    Definition Classes
    root
  • package com
    Definition Classes
    root
  • package datastax
    Definition Classes
    com
  • package spark
    Definition Classes
    datastax
  • package connector

    The root package of Cassandra connector for Apache Spark.

    The root package of Cassandra connector for Apache Spark. Offers handy implicit conversions that add Cassandra-specific methods to SparkContext and RDD.

    Call cassandraTable method on the SparkContext object to create a CassandraRDD exposing Cassandra tables as Spark RDDs.

    Call RDDFunctions saveToCassandra function on any RDD to save distributed collection to a Cassandra table.

    Example:

    CREATE KEYSPACE test WITH replication = {'class': 'SimpleStrategy', 'replication_factor': 1 };
CREATE TABLE test.words (word text PRIMARY KEY, count int);
INSERT INTO test.words(word, count) VALUES ("and", 50);
    import com.datastax.spark.connector._

val sparkMasterHost = "127.0.0.1"
val cassandraHost = "127.0.0.1"
val keyspace = "test"
val table = "words"

// Tell Spark the address of one Cassandra node:
val conf = new SparkConf(true).set("spark.cassandra.connection.host", cassandraHost)

// Connect to the Spark cluster:
val sc = new SparkContext("spark://" + sparkMasterHost + ":7077", "example", conf)

// Read the table and print its contents:
val rdd = sc.cassandraTable(keyspace, table)
rdd.toArray().foreach(println)

// Write two rows to the table:
val col = sc.parallelize(Seq(("of", 1200), ("the", "863")))
col.saveToCassandra(keyspace, table)

sc.stop()
    Definition Classes
    spark
  • package cql

    Contains a cql.CassandraConnector object which is used to connect to a Cassandra cluster and to send CQL statements to it.

    Contains a cql.CassandraConnector object which is used to connect to a Cassandra cluster and to send CQL statements to it. CassandraConnector provides a Scala-idiomatic way of working with Cluster and Session object and takes care of connection pooling and proper resource disposal.

    Definition Classes
    connector
  • package japi
    Definition Classes
    connector
  • package mapper

    Provides machinery for mapping Cassandra tables to user defined Scala classes or tuples.

    Provides machinery for mapping Cassandra tables to user defined Scala classes or tuples. The main class in this package is mapper.ColumnMapper responsible for matching Scala object's properties with Cassandra column names.

    Definition Classes
    connector
  • package rdd

    Contains com.datastax.spark.connector.rdd.CassandraTableScanRDD class that is the main entry point for analyzing Cassandra data from Spark.

    Contains com.datastax.spark.connector.rdd.CassandraTableScanRDD class that is the main entry point for analyzing Cassandra data from Spark.

    Definition Classes
    connector
  • package streaming
    Definition Classes
    connector
  • CassandraStreamingRDD
  • DStreamFunctions
  • StreamingContextFunctions
  • package types

    Offers type conversion magic, so you can receive Cassandra column values in a form you like the most.

    Offers type conversion magic, so you can receive Cassandra column values in a form you like the most. Simply specify the type you want to use on the Scala side, and the column value will be converted automatically. Works also with complex objects like collections.

    Definition Classes
    connector
  • package util

    Useful stuff that didn't fit elsewhere.

    Useful stuff that didn't fit elsewhere.

    Definition Classes
    connector
  • package writer

    Contains components for writing RDDs to Cassandra

    Contains components for writing RDDs to Cassandra

    Definition Classes
    connector

package streaming

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. streaming
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. class CassandraStreamingRDD[R] extends CassandraTableScanRDD[R]

    RDD representing a Cassandra table for Spark Streaming.

    RDD representing a Cassandra table for Spark Streaming.

    See also

    com.datastax.spark.connector.rdd.CassandraTableScanRDD

  2. class DStreamFunctions[T] extends WritableToCassandra[T] with Serializable with Logging
  3. class StreamingContextFunctions extends SparkContextFunctions

    Provides Cassandra-specific methods on org.apache.spark.streaming.StreamingContext.

Value Members

  1. implicit def toDStreamFunctions[T](ds: DStream[T])(implicit arg0: ClassTag[T]): DStreamFunctions[T]
  2. implicit def toStreamingContextFunctions(ssc: StreamingContext): SparkContextFunctions

Inherited from AnyRef

Inherited from Any

Ungrouped