Packages

  • package root
    Definition Classes
    root
  • package io
    Definition Classes
    root
  • package tarantool
    Definition Classes
    io
  • package spark
    Definition Classes
    tarantool
  • package connector

    Tarantool connector for Apache Spark.

    Tarantool connector for Apache Spark.

    Call tarantoolSpace method on the SparkContext object to create a TarantoolRDD exposing Tarantool space as a Spark RDD.

    Example:

    Execute the following on a Cartridge router node (the tarantool/crud module must be installed):

    local crud = require('crud')

crud.insert('test_space', {1, nil, 'a1', 'Don Quixote', 'Miguel de Cervantes', 1605})
crud.insert('test_space', {2, nil, 'a2', 'The Great Gatsby', 'F. Scott Fitzgerald', 1925})
crud.insert('test_space', {3, nil, 'a3', 'War and Peace', 'Leo Tolstoy', 1869})

    Write the following in your Java client code:

    import io.tarantool.spark.connector._

val sparkMasterHost = "127.0.0.1"
val tarantoolRouterAddress = "127.0.0.1:3301"
val space = "test_space"

// Populate the Spark config with the address of a Cartridge router node and credentials:
val conf = new SparkConf(true)
conf.set ("tarantool.username", "admin")
conf.set ("tarantool.password", "testapp-cluster-cookie")
conf.set ("tarantool.hosts", tarantoolRouterAddress)

// Connect to the Spark cluster:
val sc = new SparkContext("spark://" + sparkMasterHost + ":7077", "example", conf)

// Read the space and print its contents:
val rdd = sc.tarantoolSpace(space)
rdd.toArray().foreach(println)

sc.stop()
    Definition Classes
    spark
  • package config
    Definition Classes
    connector
  • package connection
    Definition Classes
    connector
  • package partition
    Definition Classes
    connector
  • package rdd
    Definition Classes
    connector
  • package converter
  • TarantoolBaseRDD
  • TarantoolJavaRDD
  • TarantoolReadRDD
  • TarantoolWriteRDD
  • package util
    Definition Classes
    connector

package rdd

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. trait TarantoolBaseRDD extends AnyRef

    Baic trait for RDD implementations.

  2. class TarantoolJavaRDD[R] extends JavaRDD[R]

    Bridge from Scala TarantoolReadRDD to Java.

    Bridge from Scala TarantoolReadRDD to Java.

    Instances of this class may be instantiated using methods of SparkContextJavaFunctions.

  3. class TarantoolReadRDD[R] extends RDD[R] with TarantoolBaseRDD

    Tarantool RDD implementation for read operations

    Tarantool RDD implementation for read operations

    R

    target POJO type

  4. class TarantoolWriteRDD[R] extends TarantoolBaseRDD with Serializable with Logging

    Tarantool RDD implementation for write operations

    Tarantool RDD implementation for write operations

    R

    target POJO type

Value Members

  1. object TarantoolReadRDD extends Serializable
  2. object TarantoolWriteRDD extends Serializable

Ungrouped