Class

za.co.absa.cobrix.spark.cobol.reader.varlen

VarLenNestedReader

Related Doc: package varlen

Permalink

final class VarLenNestedReader extends VarLenReader

The Cobol data reader for variable length records that gets input binary data as a stream and produces nested structure schema

Annotations
@throws( classOf[IllegalArgumentException] )
Linear Supertypes
VarLenReader, Reader, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. VarLenNestedReader
  2. VarLenReader
  3. Reader
  4. Serializable
  5. Serializable
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new VarLenNestedReader(copybookContents: Seq[String], readerProperties: ReaderParameters)

    Permalink

    copybookContents

    The contents of a copybook.

    readerProperties

    Additional properties for customizing the reader.

Type Members

  1. type Field = String

    Permalink
    Definition Classes
    Reader

  2. type Value = String

    Permalink
    Definition Classes
    Reader

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  7. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  8. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  9. def generateIndex(binaryData: SimpleStream, fileNumber: Int, isRdwBigEndian: Boolean): ArrayBuffer[SparseIndexEntry]

    Permalink

    Traverses the data sequentially as fast as possible to generate record index.

    Traverses the data sequentially as fast as possible to generate record index. This index will be used to distribute workload of the conversion.

    binaryData

    A stream of input binary data

    fileNumber

    A file number uniquely identified a particular file of the data set

    returns

    An index of the file

    Definition Classes
    VarLenNestedReader → VarLenReader

  10. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  11. def getCobolSchema: CobolSchema

    Permalink
    Definition Classes
    VarLenNestedReader → Reader

  12. def getRecordEndOffset: Int

    Permalink
    Definition Classes
    VarLenNestedReader → Reader

  13. def getRecordStartOffset: Int

    Permalink
    Definition Classes
    VarLenNestedReader → Reader

  14. def getRowIterator(binaryData: SimpleStream, startingFileOffset: Long, fileNumber: Int, startingRecordIndex: Long): Iterator[Row]

    Permalink

    Returns a file iterator between particular offsets.

    Returns a file iterator between particular offsets. This is for faster traversal of big binary files

    binaryData

    A stream positioned at the beginning of the intended file portion to read

    startingFileOffset

    An offset of the file where parsing should be started

    fileNumber

    A file number uniquely identified a particular file of the data set

    startingRecordIndex

    A starting record index of the data

    returns

    An iterator of Spark Row objects

    Definition Classes
    VarLenNestedReader → VarLenReader

  15. def getSparkSchema: StructType

    Permalink
    Definition Classes
    VarLenNestedReader → Reader

  16. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  17. def isIndexGenerationNeeded: Boolean

    Permalink

    Returns true if index generation is requested

    Returns true if index generation is requested

    Definition Classes
    VarLenNestedReader → VarLenReader

  18. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  19. def isRdwBigEndian: Boolean

    Permalink

    Returns true if RDW header of variable length files is big endian

    Returns true if RDW header of variable length files is big endian

    Definition Classes
    VarLenNestedReader → VarLenReader

  20. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  21. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  22. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  23. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  24. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  25. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  26. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  27. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from VarLenReader

Inherited from Reader

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped