sql

Type Members

1. class Column extends Logging

   A column that will be computed based on the data in a DataFrame.

2. class ColumnName extends Column

   :: Experimental :: A convenient class used for constructing schema.

3. type DataFrame = Dataset[Row]

4. final class DataFrameNaFunctions extends AnyRef

   :: Experimental :: Functionality for working with missing data in DataFrames.

5. class DataFrameReader extends Logging

   Interface used to load a Dataset from external storage systems (e.

6. final class DataFrameStatFunctions extends AnyRef

   :: Experimental :: Statistic functions for DataFrames.

7. final class DataFrameWriter[T] extends AnyRef

   Interface used to write a Dataset to external storage systems (e.

8. class Dataset[T] extends Serializable

   A Dataset is a strongly typed collection of domain-specific objects that can be transformed in parallel using functional or relational operations.

9. case class DatasetHolder[T] extends Product with Serializable

   A container for a Dataset, used for implicit conversions in Scala.

10. class ExperimentalMethods extends AnyRef

    :: Experimental :: Holder for experimental methods for the bravest.

11. abstract class ForeachWriter[T] extends Serializable

    :: Experimental :: A class to consume data generated by a StreamingQuery.

12. class KeyValueGroupedDataset[K, V] extends Serializable

    :: Experimental :: A Dataset has been logically grouped by a user specified grouping key.

13. class RelationalGroupedDataset extends AnyRef

    A set of methods for aggregations on a DataFrame, created by Dataset.groupBy.

14. class RuntimeConfig extends AnyRef

    Runtime configuration interface for Spark.

15. class SQLContext extends Logging with Serializable

    The entry point for working with structured data (rows and columns) in Spark 1.

16. abstract class SQLImplicits extends AnyRef

    A collection of implicit methods for converting common Scala objects into Datasets.

17. class SaveMode extends Enum[SaveMode]

18. class SparkSession extends Serializable with Logging

    The entry point to programming Spark with the Dataset and DataFrame API.

19. type Strategy = SparkStrategy

    Converts a logical plan into zero or more SparkPlans.

    Converts a logical plan into zero or more SparkPlans. This API is exposed for experimenting with the query planner and is not designed to be stable across spark releases. Developers writing libraries should instead consider using the stable APIs provided in org.apache.spark.sql.sources

    Annotations

    @DeveloperApi()

20. class TypedColumn[-T, U] extends Column

    A Column where an Encoder has been given for the expected input and return type.

21. class UDFRegistration extends Logging

    Functions for registering user-defined functions.