Packages

  • package root
    Definition Classes
    root
  • package io
    Definition Classes
    root
  • package tarantool
    Definition Classes
    io
  • package spark
    Definition Classes
    tarantool
  • package connector

    Tarantool connector for Apache Spark.

    Tarantool connector for Apache Spark.

    Call tarantoolSpace method on the SparkContext object to create a TarantoolRDD exposing Tarantool space as a Spark RDD.

    Example:

    Execute the following on a Cartridge router node (the tarantool/crud module must be installed):

    local crud = require('crud')

crud.insert('test_space', {1, nil, 'a1', 'Don Quixote', 'Miguel de Cervantes', 1605})
crud.insert('test_space', {2, nil, 'a2', 'The Great Gatsby', 'F. Scott Fitzgerald', 1925})
crud.insert('test_space', {3, nil, 'a3', 'War and Peace', 'Leo Tolstoy', 1869})

    Write the following in your Java client code:

    import io.tarantool.spark.connector._

val sparkMasterHost = "127.0.0.1"
val tarantoolRouterAddress = "127.0.0.1:3301"
val space = "test_space"

// Populate the Spark config with the address of a Cartridge router node and credentials:
val conf = new SparkConf(true)
conf.set ("tarantool.username", "admin")
conf.set ("tarantool.password", "testapp-cluster-cookie")
conf.set ("tarantool.hosts", tarantoolRouterAddress)

// Connect to the Spark cluster:
val sc = new SparkContext("spark://" + sparkMasterHost + ":7077", "example", conf)

// Read the space and print its contents:
val rdd = sc.tarantoolSpace(space)
rdd.toArray().foreach(println)

sc.stop()
    Definition Classes
    spark
  • package config
    Definition Classes
    connector
  • Credentials
  • ErrorTypes
  • ReadConfig
  • Retries
  • StaticClusterAddressProvider
  • TarantoolConfig
  • TarantoolConfigBase
  • TarantoolDefaults
  • Timeouts
  • WriteConfig
  • package connection
    Definition Classes
    connector
  • package partition
    Definition Classes
    connector
  • package rdd
    Definition Classes
    connector
  • package util
    Definition Classes
    connector

package config

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. Protected

Type Members

  1. case class Credentials(username: String, password: String) extends Serializable with Product
  2. case class ReadConfig(spaceName: String, cursorBatchSize: Int = ReadConfig.DEFAULT_CURSOR_BATCH_SIZE, batchSize: Int = ReadConfig.DEFAULT_BATCH_SIZE, partitioner: TarantoolPartitioner = new TarantoolSinglePartitioner(), conditions: Conditions = Conditions.any()) extends Serializable with Product
  3. case class Retries(errorType: ErrorType, retryAttempts: Option[Int], delay: Option[Int]) extends Serializable with Product
  4. class StaticClusterAddressProvider extends TarantoolClusterAddressProvider
  5. case class TarantoolConfig(hosts: Seq[TarantoolServerAddress], credentials: Option[Credentials], timeouts: Timeouts, connections: Option[Int], retries: Option[Retries]) extends Serializable with Product
  6. case class TarantoolConfigBase() extends Product with Serializable

  7. case class Timeouts(connect: Option[Int], read: Option[Int], request: Option[Int]) extends Serializable with Product
  8. case class WriteConfig(spaceName: String, batchSize: Int = WriteConfig.DEFAULT_BATCH_SIZE, stopOnError: Boolean = true, rollbackOnError: Boolean = true, transformFieldNames: FieldNameTransformation = FieldNameTransformations.NONE) extends Serializable with Product

Value Members

  1. object ErrorTypes extends Enumeration
  2. object ReadConfig extends TarantoolConfigBase
  3. object TarantoolConfig extends Serializable
  4. object TarantoolDefaults
  5. object WriteConfig extends TarantoolConfigBase

Ungrouped