Class

za.co.absa.cobrix.spark.cobol.source.parameters

CobolParameters

Related Doc: package parameters

Permalink

case class CobolParameters(copybookPath: Option[String], multiCopybookPath: Seq[String], copybookContent: Option[String], sourcePath: Option[String], isEbcdic: Boolean, ebcdicCodePage: String, ebcdicCodePageClass: Option[String], asciiCharset: String, floatingPointFormat: FloatingPointFormat, recordStartOffset: Int, recordEndOffset: Int, variableLengthParams: Option[VariableLengthParameters], schemaRetentionPolicy: SchemaRetentionPolicy, stringTrimmingPolicy: StringTrimmingPolicy, multisegmentParams: Option[MultisegmentParameters], commentPolicy: CommentPolicy, dropGroupFillers: Boolean, nonTerminals: Seq[String], debugIgnoreFileSize: Boolean) extends Product with Serializable

This class holds parameters for the job.

copybookPath

String containing the path to the copybook in a given file system.

multiCopybookPath

Sequence containing the paths to the copybooks.

copybookContent

String containing the actual content of the copybook. Either this, the copybookPath, or multiCopybookPath parameter must be specified.

sourcePath

String containing the path to the Cobol file to be parsed.

isEbcdic

If true the input data file encoding is EBCDIC, otherwise it is ASCII

ebcdicCodePage

Specifies what code page to use for EBCDIC to ASCII/Unicode conversions

ebcdicCodePageClass

An optional custom code page conversion class provided by a user

asciiCharset

A charset for ASCII data

floatingPointFormat

A format of floating-point numbers

recordStartOffset

A number of bytes to skip at the beginning of the record before parsing a record according to a copybook

recordEndOffset

A number of bytes to skip at the end of each record

variableLengthParams

VariableLengthParameters containing the specifications for the consumption of variable-length Cobol records.

schemaRetentionPolicy

A copybook usually has a root group struct element that acts like a rowtag in XML. This can be retained in Spark schema or can be collapsed

stringTrimmingPolicy

Specify if and how strings should be trimmed when parsed

multisegmentParams

Parameters for reading multisegment mainframe files

commentPolicy

A comment truncation policy

dropGroupFillers

If true the parser will drop all FILLER fields, even GROUP FILLERS that have non-FILLER nested fields

nonTerminals

A list of non-terminals (GROUPS) to combine and parse as primitive fields

debugIgnoreFileSize

If true the fixed length file reader won't check file size divisibility. Useful for debugging binary file / copybook mismatches.

Linear Supertypes
Serializable, Serializable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CobolParameters
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new CobolParameters(copybookPath: Option[String], multiCopybookPath: Seq[String], copybookContent: Option[String], sourcePath: Option[String], isEbcdic: Boolean, ebcdicCodePage: String, ebcdicCodePageClass: Option[String], asciiCharset: String, floatingPointFormat: FloatingPointFormat, recordStartOffset: Int, recordEndOffset: Int, variableLengthParams: Option[VariableLengthParameters], schemaRetentionPolicy: SchemaRetentionPolicy, stringTrimmingPolicy: StringTrimmingPolicy, multisegmentParams: Option[MultisegmentParameters], commentPolicy: CommentPolicy, dropGroupFillers: Boolean, nonTerminals: Seq[String], debugIgnoreFileSize: Boolean)

    Permalink

    copybookPath

    String containing the path to the copybook in a given file system.

    multiCopybookPath

    Sequence containing the paths to the copybooks.

    copybookContent

    String containing the actual content of the copybook. Either this, the copybookPath, or multiCopybookPath parameter must be specified.

    sourcePath

    String containing the path to the Cobol file to be parsed.

    isEbcdic

    If true the input data file encoding is EBCDIC, otherwise it is ASCII

    ebcdicCodePage

    Specifies what code page to use for EBCDIC to ASCII/Unicode conversions

    ebcdicCodePageClass

    An optional custom code page conversion class provided by a user

    asciiCharset

    A charset for ASCII data

    floatingPointFormat

    A format of floating-point numbers

    recordStartOffset

    A number of bytes to skip at the beginning of the record before parsing a record according to a copybook

    recordEndOffset

    A number of bytes to skip at the end of each record

    variableLengthParams

    VariableLengthParameters containing the specifications for the consumption of variable-length Cobol records.

    schemaRetentionPolicy

    A copybook usually has a root group struct element that acts like a rowtag in XML. This can be retained in Spark schema or can be collapsed

    stringTrimmingPolicy

    Specify if and how strings should be trimmed when parsed

    multisegmentParams

    Parameters for reading multisegment mainframe files

    commentPolicy

    A comment truncation policy

    dropGroupFillers

    If true the parser will drop all FILLER fields, even GROUP FILLERS that have non-FILLER nested fields

    nonTerminals

    A list of non-terminals (GROUPS) to combine and parse as primitive fields

    debugIgnoreFileSize

    If true the fixed length file reader won't check file size divisibility. Useful for debugging binary file / copybook mismatches.

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. val asciiCharset: String

    Permalink

    A charset for ASCII data

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. val commentPolicy: CommentPolicy

    Permalink

    A comment truncation policy

  8. val copybookContent: Option[String]

    Permalink

    String containing the actual content of the copybook.

    String containing the actual content of the copybook. Either this, the copybookPath, or multiCopybookPath parameter must be specified.

  9. val copybookPath: Option[String]

    Permalink

    String containing the path to the copybook in a given file system.

  10. val debugIgnoreFileSize: Boolean

    Permalink

    If true the fixed length file reader won't check file size divisibility.

    If true the fixed length file reader won't check file size divisibility. Useful for debugging binary file / copybook mismatches.

  11. val dropGroupFillers: Boolean

    Permalink

    If true the parser will drop all FILLER fields, even GROUP FILLERS that have non-FILLER nested fields

  12. val ebcdicCodePage: String

    Permalink

    Specifies what code page to use for EBCDIC to ASCII/Unicode conversions

  13. val ebcdicCodePageClass: Option[String]

    Permalink

    An optional custom code page conversion class provided by a user

  14. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  15. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  16. val floatingPointFormat: FloatingPointFormat

    Permalink

    A format of floating-point numbers

  17. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  18. val isEbcdic: Boolean

    Permalink

    If true the input data file encoding is EBCDIC, otherwise it is ASCII

  19. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  20. val multiCopybookPath: Seq[String]

    Permalink

    Sequence containing the paths to the copybooks.

  21. val multisegmentParams: Option[MultisegmentParameters]

    Permalink

    Parameters for reading multisegment mainframe files

  22. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  23. val nonTerminals: Seq[String]

    Permalink

    A list of non-terminals (GROUPS) to combine and parse as primitive fields

  24. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  25. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  26. val recordEndOffset: Int

    Permalink

    A number of bytes to skip at the end of each record

  27. val recordStartOffset: Int

    Permalink

    A number of bytes to skip at the beginning of the record before parsing a record according to a copybook

  28. val schemaRetentionPolicy: SchemaRetentionPolicy

    Permalink

    A copybook usually has a root group struct element that acts like a rowtag in XML.

    A copybook usually has a root group struct element that acts like a rowtag in XML. This can be retained in Spark schema or can be collapsed

  29. val sourcePath: Option[String]

    Permalink

    String containing the path to the Cobol file to be parsed.

  30. val stringTrimmingPolicy: StringTrimmingPolicy

    Permalink

    Specify if and how strings should be trimmed when parsed

  31. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  32. val variableLengthParams: Option[VariableLengthParameters]

    Permalink

    VariableLengthParameters containing the specifications for the consumption of variable-length Cobol records.

  33. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  34. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  35. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped