: Attribute name as defined in the source dataset and as received in the file
: Is it an array ?
: Should this attribute always be present in the source
: Should this attribute be applied a privacy transformation at ingestion time
: free text for attribute description
: If present, the attribute is renamed with this name
: If present, what kind of stat should be computed for this field
: List of sub-attributes (valid for JSON and XML files only)
: Valid only when file format is POSITION
: Default value for this attribute when it is not present.
: Tags associated with this attribute
: Should we trim the attribute value ?
: Scripted field : SQL request on renamed column
: Is it an array ?
: List of sub-attributes (valid for JSON and XML files only)
Check attribute validity An attribute is valid if :
Check attribute validity An attribute is valid if :
true if attribute is valid
: free text for attribute description
: Default value for this attribute when it is not present.
renamed column if defined, source name otherwise
: If present, what kind of stat should be computed for this field
: Attribute name as defined in the source dataset and as received in the file
: Valid only when file format is POSITION
Spark Type if this attribute is a primitive type of array of primitive type
Spark Type if this attribute is a primitive type of array of primitive type
Primitive type if attribute is a leaf node or array of primitive type, None otherwise
: Should this attribute be applied a privacy transformation at ingestion time
: If present, the attribute is renamed with this name
: Should this attribute always be present in the source
: Scripted field : SQL request on renamed column
Go get recursively the Spark tree type of this object
Go get recursively the Spark tree type of this object
Spark type of this attribute
: Tags associated with this attribute
: Should we trim the attribute value ?
A field in the schema. For struct fields, the field "attributes" contains all sub attributes
: Attribute name as defined in the source dataset and as received in the file
: Is it an array ?
: Should this attribute always be present in the source
: Should this attribute be applied a privacy transformation at ingestion time
: free text for attribute description
: If present, the attribute is renamed with this name
: If present, what kind of stat should be computed for this field
: List of sub-attributes (valid for JSON and XML files only)
: Valid only when file format is POSITION
: Default value for this attribute when it is not present.
: Tags associated with this attribute
: Should we trim the attribute value ?
: Scripted field : SQL request on renamed column