Packages

  • package root
    Definition Classes
    root
  • package io
    Definition Classes
    root
  • package tarantool
    Definition Classes
    io
  • package spark
    Definition Classes
    tarantool
  • package connector

    Tarantool connector for Apache Spark.

    Tarantool connector for Apache Spark.

    Call tarantoolSpace method on the SparkContext object to create a TarantoolRDD exposing Tarantool space as a Spark RDD.

    Example:

    Execute the following on a Cartridge router node (the tarantool/crud module must be installed):

    local crud = require('crud')

crud.insert('test_space', {1, nil, 'a1', 'Don Quixote', 'Miguel de Cervantes', 1605})
crud.insert('test_space', {2, nil, 'a2', 'The Great Gatsby', 'F. Scott Fitzgerald', 1925})
crud.insert('test_space', {3, nil, 'a3', 'War and Peace', 'Leo Tolstoy', 1869})

    Write the following in your Java client code:

    import io.tarantool.spark.connector._

val sparkMasterHost = "127.0.0.1"
val tarantoolRouterAddress = "127.0.0.1:3301"
val space = "test_space"

// Populate the Spark config with the address of a Cartridge router node and credentials:
val conf = new SparkConf(true)
conf.set ("tarantool.username", "admin")
conf.set ("tarantool.password", "testapp-cluster-cookie")
conf.set ("tarantool.hosts", tarantoolRouterAddress)

// Connect to the Spark cluster:
val sc = new SparkContext("spark://" + sparkMasterHost + ":7077", "example", conf)

// Read the space and print its contents:
val rdd = sc.tarantoolSpace(space)
rdd.toArray().foreach(println)

sc.stop()
    Definition Classes
    spark
  • package config
    Definition Classes
    connector
  • package connection
    Definition Classes
    connector
  • package partition
    Definition Classes
    connector
  • TarantoolPartition
  • TarantoolPartitioner
  • TarantoolSinglePartitioner
  • package rdd
    Definition Classes
    connector
  • package util
    Definition Classes
    connector

package partition

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. Protected

Type Members

  1. case class TarantoolPartition(index: Int, nodes: Seq[TarantoolServerAddress], conditions: Conditions) extends Partition with Product with Serializable

    An identifier for a partition in a TarantoolRDD.

    An identifier for a partition in a TarantoolRDD.

    index

    The partition's index within its parent RDD

    conditions

    The query conditions for the data within this partition

  2. trait TarantoolPartitioner extends Serializable

    The TarantoolPartitioner provides the partitions of the whole space (it may lie on a single instance, in a cluster or be sharded in a cluster)

  3. class TarantoolSinglePartitioner extends TarantoolPartitioner

    Creates a single partition for the whole space.

Value Members

  1. case object TarantoolSinglePartitioner extends TarantoolSinglePartitioner with Product with Serializable

Ungrouped