Packages

  • package root
    Definition Classes
    root
  • package io
    Definition Classes
    root
  • package tarantool
    Definition Classes
    io
  • package spark
    Definition Classes
    tarantool
  • package connector

    Tarantool connector for Apache Spark.

    Tarantool connector for Apache Spark.

    Call tarantoolSpace method on the SparkContext object to create a TarantoolRDD exposing Tarantool space as a Spark RDD.

    Example:

    Execute the following on a Cartridge router node (the tarantool/crud module must be installed):

    local crud = require('crud')

crud.insert('test_space', {1, nil, 'a1', 'Don Quixote', 'Miguel de Cervantes', 1605})
crud.insert('test_space', {2, nil, 'a2', 'The Great Gatsby', 'F. Scott Fitzgerald', 1925})
crud.insert('test_space', {3, nil, 'a3', 'War and Peace', 'Leo Tolstoy', 1869})

    Write the following in your Java client code:

    import io.tarantool.spark.connector._

val sparkMasterHost = "127.0.0.1"
val tarantoolRouterAddress = "127.0.0.1:3301"
val space = "test_space"

// Populate the Spark config with the address of a Cartridge router node and credentials:
val conf = new SparkConf(true)
conf.set ("tarantool.username", "admin")
conf.set ("tarantool.password", "testapp-cluster-cookie")
conf.set ("tarantool.hosts", tarantoolRouterAddress)

// Connect to the Spark cluster:
val sc = new SparkContext("spark://" + sparkMasterHost + ":7077", "example", conf)

// Read the space and print its contents:
val rdd = sc.tarantoolSpace(space)
rdd.toArray().foreach(println)

sc.stop()
    Definition Classes
    spark
  • package config
    Definition Classes
    connector
  • package connection
    Definition Classes
    connector
  • package partition
    Definition Classes
    connector
  • package rdd
    Definition Classes
    connector
  • package converter
  • TarantoolBaseRDD
  • TarantoolJavaRDD
  • TarantoolReadRDD
  • TarantoolWriteRDD
  • package util
    Definition Classes
    connector

package rdd

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. Protected

Package Members

  1. package converter

Type Members

  1. trait TarantoolBaseRDD extends AnyRef

    Baic trait for RDD implementations.

  2. class TarantoolJavaRDD[R] extends JavaRDD[R]

    Bridge from Scala TarantoolReadRDD to Java.

    Bridge from Scala TarantoolReadRDD to Java.

    Instances of this class may be instantiated using methods of SparkContextJavaFunctions.

  3. class TarantoolReadRDD[R] extends RDD[R] with TarantoolBaseRDD

    Tarantool RDD implementation for read operations

    Tarantool RDD implementation for read operations

    R

    target POJO type

  4. class TarantoolWriteRDD[R] extends TarantoolBaseRDD with Serializable with Logging

    Tarantool RDD implementation for write operations

    Tarantool RDD implementation for write operations

    R

    target POJO type

Value Members

  1. object TarantoolReadRDD extends Serializable
  2. object TarantoolWriteRDD extends Serializable

Ungrouped