package xml
- Alphabetic
- By Inheritance
- xml
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Type Members
-
class
DefaultSource extends RelationProvider with SchemaRelationProvider with CreatableRelationProvider with DataSourceRegister
Provides access to XML data from pure SQL statements (i.e.
Provides access to XML data from pure SQL statements (i.e. for users of the JDBC server).
-
implicit
class
XmlContext extends Serializable
Adds a method,
xmlFile
, to SQLContext that allows reading XML data. -
implicit
class
XmlDataFrameReader extends AnyRef
Adds a method,
xml
, to DataFrameReader that allows you to read avro files using the DataFileReader -
implicit
class
XmlDataFrameWriter[T] extends AnyRef
Adds a method,
xml
, to DataFrameWriter that allows you to write avro files using the DataFileWriter - case class XmlDataToCatalyst(child: Expression, schema: DataType, options: XmlOptions) extends UnaryExpression with CodegenFallback with ExpectsInputTypes with Product with Serializable
-
class
XmlInputFormat extends TextInputFormat
Reads records that are delimited by a specific start/end tag.
-
class
XmlReader extends Serializable
A collection of static functions for working with XML files in Spark SQL
- case class XmlRelation(baseRDD: () ⇒ RDD[String], location: Option[String], parameters: Map[String, String], userSchema: StructType = null)(sqlContext: SQLContext) extends BaseRelation with InsertableRelation with PrunedScan with Product with Serializable
-
implicit
class
XmlSchemaRDD extends AnyRef
Adds a method,
saveAsXmlFile
, to DataFrame that allows writing XML data.Adds a method,
saveAsXmlFile
, to DataFrame that allows writing XML data. If compressionCodec is not null the resulting output will be compressed. Note that a codec entry in the parameters map will be ignored.
Value Members
-
def
from_xml_string(xml: String, schema: StructType, options: Map[String, String] = Map.empty): Row
- xml
XML document to parse, as string
- schema
the schema to use when parsing the XML string
- options
key-value pairs that correspond to those supported by XmlOptions
- returns
Row representing the parsed XML structure
- Annotations
- @Experimental()
-
def
schema_of_xml(ds: Dataset[String], options: Map[String, String] = Map.empty): StructType
Infers the schema of XML documents as strings.
Infers the schema of XML documents as strings.
- ds
Dataset of XML strings
- options
additional XML parsing options
- returns
inferred schema for XML
- Annotations
- @Experimental()
-
def
schema_of_xml_array(ds: Dataset[Array[String]], options: Map[String, String] = Map.empty): ArrayType
Infers the schema of XML documents when inputs are arrays of strings, each an XML doc.
Infers the schema of XML documents when inputs are arrays of strings, each an XML doc.
- ds
Dataset of XML strings
- options
additional XML parsing options
- returns
inferred schema for XML. Will be an ArrayType[StructType].
- Annotations
- @Experimental()
- object XmlInputFormat
-
object
functions
Support functions for working with XML columns directly.