Package

org.apache.spark.api

python

Permalink

package python

Visibility
  1. Public
  2. All

Type Members

  1. trait Converter[T, +U] extends Serializable

    Permalink

    A trait for use with reading custom classes in PySpark.

    A trait for use with reading custom classes in PySpark. Implement this trait and add custom transformation code by overriding the convert method.

  2. case class TestWritable(str: String, int: Int, double: Double) extends Writable with Product with Serializable

    Permalink

    A class to test Pyrolite serialization on the Scala side, that will be deserialized in Python

Value Members

  1. object WriteInputFormatTestDataGenerator

    Permalink

    This object contains method to generate SequenceFile test data and write it to a given directory (probably a temp directory)

Ungrouped