org.apache.spark

sql

package sql

Allows the execution of relational queries, including those expressed in SQL using Spark.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. sql
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. class Column extends Logging

    :: Experimental :: A column in a DataFrame.

  2. class ColumnName extends Column

    :: Experimental :: A convenient class used for constructing schema.

  3. class DataFrame extends RDDApi[Row] with Serializable

    :: Experimental :: A distributed collection of data organized into named columns.

  4. final class DataFrameNaFunctions extends AnyRef

    :: Experimental :: Functionality for working with missing data in DataFrames.

  5. class DataFrameReader extends AnyRef

    :: Experimental :: Interface used to load a DataFrame from external storage systems (e.

  6. final class DataFrameStatFunctions extends AnyRef

    :: Experimental :: Statistic functions for DataFrames.

  7. final class DataFrameWriter extends AnyRef

    :: Experimental :: Interface used to write a DataFrame to external storage systems (e.

  8. class ExperimentalMethods extends AnyRef

    :: Experimental :: Holder for experimental methods for the bravest.

  9. class GroupedData extends AnyRef

    :: Experimental :: A set of methods for aggregations on a DataFrame, created by DataFrame.groupBy.

  10. class SQLContext extends Logging with Serializable

    The entry point for working with structured data (rows and columns) in Spark.

  11. class SaveMode extends Enum[SaveMode]

  12. type Strategy = GenericStrategy[SparkPlan]

    Converts a logical plan into zero or more SparkPlans.

    Converts a logical plan into zero or more SparkPlans. This API is exposed for experimenting with the query planner and is not designed to be stable across spark releases. Developers writing libraries should instead consider using the stable APIs provided in org.apache.spark.sql.sources

    Annotations
    @DeveloperApi()
  13. class UDFRegistration extends Logging

    Functions for registering user-defined functions.

  14. case class UserDefinedFunction(f: AnyRef, dataType: DataType) extends Product with Serializable

    A user-defined function.

  15. type SchemaRDD = DataFrame

    Type alias for DataFrame.

    Type alias for DataFrame. Kept here for backward source compatibility for Scala.

    Annotations
    @deprecated
    Deprecated

    (Since version 1.3.0) use DataFrame

Value Members

  1. object SQLContext extends Serializable

    This SQLContext object contains utility functions to create a singleton SQLContext instance, or to get the last created SQLContext instance.

  2. package api

    Contains API classes that are specific to a single language (i.

  3. package execution

    :: DeveloperApi :: An execution engine for relational query plans that runs on top Spark and returns RDDs.

  4. package expressions

  5. object functions

    :: Experimental :: Functions available for DataFrame.

  6. package jdbc

  7. package sources

    A set of APIs for adding data sources to Spark SQL.

  8. package test

Inherited from AnyRef

Inherited from Any

Ungrouped