Parses the options for the occurs mappings.
Parses the options for the occurs mappings.
Parameters provided by spark.read.option(...)
Returns a mapping for OCCURS fields
Parses the list of redefines and their corresponding segment ids.
Parses the list of redefines and their corresponding segment ids.
Example: For
sprak.read .option("redefine-segment-id-map:0", "COMPANY => C,D") .option("redefine-segment-id-map:1", "CONTACT => P")
The corresponding mapping will be:
"C" -> "COMPANY" "D" -> "COMPANY" "P" -> "PERSON"
Parameters provided by spark.read.option(...)
Returns a sequence of segment ids on the order of hierarchy levels
Parses the list of sergent redefine fields and their children for a hierarchical data.
Parses the list of sergent redefine fields and their children for a hierarchical data. Produces a mapping between redefined fields and their parents. Root level redefines are not added to the mapping since they don't have parents.
Example: For
spark.read .option("segment-children:0", "COMPANY => DEPT,CUSTOMER") .option("segment-children:1", "DEPT => EMPLOYEE,OFFICE")
The corresponding mapping will be:
"DEPT" -> "COMPANY" "CUSTOMER" -> "COMPANY" "EMPLOYEE" -> "DEPT" "OFFICE" -> "DEPT"
Parameters provided by spark.read.option(...)
Returns a mapping between redefined fields and their parents
This class provides methods for parsing the parameters set as Spark options.