Packages

package xml

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. xml
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. class DefaultSource extends RelationProvider with SchemaRelationProvider with CreatableRelationProvider with DataSourceRegister

    Provides access to XML data from pure SQL statements (i.e.

    Provides access to XML data from pure SQL statements (i.e. for users of the JDBC server).

  2. implicit class XmlContext extends Serializable

    Adds a method, xmlFile, to SQLContext that allows reading XML data.

  3. implicit class XmlDataFrameReader extends AnyRef

    Adds a method, xml, to DataFrameReader that allows you to read XML files using the DataFileReader

  4. implicit class XmlDataFrameWriter[T] extends AnyRef

    Adds a method, xml, to DataFrameWriter that allows you to write XML files using the DataFileWriter

  5. case class XmlDataToCatalyst(child: Expression, schema: DataType, options: XmlOptions) extends UnaryExpression with CodegenFallback with ExpectsInputTypes with Product with Serializable
  6. class XmlInputFormat extends TextInputFormat

    Reads records that are delimited by a specific start/end tag.

  7. class XmlReader extends Serializable

    A collection of static functions for working with XML files in Spark SQL

  8. case class XmlRelation(baseRDD: () ⇒ RDD[String], location: Option[String], parameters: Map[String, String], userSchema: StructType = null)(sqlContext: SQLContext) extends BaseRelation with InsertableRelation with PrunedScan with Product with Serializable
  9. implicit class XmlSchemaRDD extends AnyRef

    Adds a method, saveAsXmlFile, to DataFrame that allows writing XML data.

    Adds a method, saveAsXmlFile, to DataFrame that allows writing XML data. If compressionCodec is not null the resulting output will be compressed. Note that a codec entry in the parameters map will be ignored.

Value Members

  1. def from_xml_string(xml: String, schema: StructType, options: Map[String, String] = Map.empty): Row

    xml

    XML document to parse, as string

    schema

    the schema to use when parsing the XML string

    options

    key-value pairs that correspond to those supported by XmlOptions

    returns

    Row representing the parsed XML structure

    Annotations
    @Experimental()
  2. def schema_of_xml(ds: Dataset[String], options: Map[String, String] = Map.empty): StructType

    Infers the schema of XML documents as strings.

    Infers the schema of XML documents as strings.

    ds

    Dataset of XML strings

    options

    additional XML parsing options

    returns

    inferred schema for XML

    Annotations
    @Experimental()
  3. def schema_of_xml_array(ds: Dataset[Array[String]], options: Map[String, String] = Map.empty): ArrayType

    Infers the schema of XML documents when inputs are arrays of strings, each an XML doc.

    Infers the schema of XML documents when inputs are arrays of strings, each an XML doc.

    ds

    Dataset of XML strings

    options

    additional XML parsing options

    returns

    inferred schema for XML. Will be an ArrayType[StructType].

    Annotations
    @Experimental()
  4. def schema_of_xml_df(df: DataFrame, options: Map[String, String] = Map.empty): StructType

    Infers the schema of XML documents as strings.

    Infers the schema of XML documents as strings.

    df

    one-column DataFrame of XML strings

    options

    additional XML parsing options

    returns

    inferred schema for XML

    Annotations
    @Experimental()
  5. object XmlInputFormat
  6. object functions

    Support functions for working with XML columns directly.

Inherited from AnyRef

Inherited from Any

Ungrouped