xml

Type Members

class DefaultSource extends RelationProvider with SchemaRelationProvider with CreatableRelationProvider with DataSourceRegister

Provides access to XML data from pure SQL statements (i.e.
Provides access to XML data from pure SQL statements (i.e. for users of the JDBC server).
implicit class XmlContext extends Serializable

Adds a method, xmlFile, to SQLContext that allows reading XML data.
implicit class XmlDataFrameReader extends AnyRef

Adds a method, xml, to DataFrameReader that allows you to read avro files using the DataFileReader
implicit class XmlDataFrameWriter[T] extends AnyRef

Adds a method, xml, to DataFrameWriter that allows you to write avro files using the DataFileWriter
case class XmlDataToCatalyst(child: Expression, schema: DataType, options: XmlOptions) extends UnaryExpression with CodegenFallback with ExpectsInputTypes with Product with Serializable
class XmlInputFormat extends TextInputFormat

Reads records that are delimited by a specific start/end tag.
class XmlReader extends Serializable

A collection of static functions for working with XML files in Spark SQL
case class XmlRelation(baseRDD: () ⇒ RDD[String], location: Option[String], parameters: Map[String, String], userSchema: StructType = null)(sqlContext: SQLContext) extends BaseRelation with InsertableRelation with PrunedScan with Product with Serializable
implicit class XmlSchemaRDD extends AnyRef

Adds a method, saveAsXmlFile, to DataFrame that allows writing XML data.
Adds a method, saveAsXmlFile, to DataFrame that allows writing XML data. If compressionCodec is not null the resulting output will be compressed. Note that a codec entry in the parameters map will be ignored.

Value Members

object XmlInputFormat
def from_xml_string(xml: String, schema: StructType, options: Map[String, String] = Map.empty): Row

xml
XML document to parse, as string
schema
the schema to use when parsing the XML string
options
key-value pairs that correspond to those supported by XmlOptions
returns
Row representing the parsed XML structure

Annotations
@Experimental()
object functions

Support functions for working with XML columns directly.
def schema_of_xml(ds: Dataset[String], options: Map[String, String] = Map.empty): StructType

Infers the schema of XML documents as strings.
Infers the schema of XML documents as strings.
ds
Dataset of XML strings
options
additional XML parsing options
returns
inferred schema for XML

Annotations
@Experimental()
def schema_of_xml_array(ds: Dataset[Array[String]], options: Map[String, String] = Map.empty): ArrayType

Infers the schema of XML documents when inputs are arrays of strings, each an XML doc.
Infers the schema of XML documents when inputs are arrays of strings, each an XML doc.
ds
Dataset of XML strings
options
additional XML parsing options
returns
inferred schema for XML. Will be an ArrayType[StructType].

Annotations
@Experimental()
def schema_of_xml_df(df: DataFrame, options: Map[String, String] = Map.empty): StructType

Infers the schema of XML documents as strings.
Infers the schema of XML documents as strings.
df
one-column DataFrame of XML strings
options
additional XML parsing options
returns
inferred schema for XML

Annotations
@Experimental()
package util

package xml

Type Members

class DefaultSource extends RelationProvider with SchemaRelationProvider with CreatableRelationProvider with DataSourceRegister

implicit class XmlContext extends Serializable

implicit class XmlDataFrameReader extends AnyRef

implicit class XmlDataFrameWriter[T] extends AnyRef

case class XmlDataToCatalyst(child: Expression, schema: DataType, options: XmlOptions) extends UnaryExpression with CodegenFallback with ExpectsInputTypes with Product with Serializable

class XmlInputFormat extends TextInputFormat

class XmlReader extends Serializable

case class XmlRelation(baseRDD: () ⇒ RDD[String], location: Option[String], parameters: Map[String, String], userSchema: StructType = null)(sqlContext: SQLContext) extends BaseRelation with InsertableRelation with PrunedScan with Product with Serializable

implicit class XmlSchemaRDD extends AnyRef

Value Members

object XmlInputFormat

def from_xml_string(xml: String, schema: StructType, options: Map[String, String] = Map.empty): Row

object functions

def schema_of_xml(ds: Dataset[String], options: Map[String, String] = Map.empty): StructType

def schema_of_xml_array(ds: Dataset[Array[String]], options: Map[String, String] = Map.empty): ArrayType

def schema_of_xml_df(df: DataFrame, options: Map[String, String] = Map.empty): StructType

package util

Inherited from AnyRef

Inherited from Any

Ungrouped