Class

org.apache.spark.sql.execution.columnar.encoding

ColumnDecoder

Related Doc: package encoding

Permalink

abstract class ColumnDecoder extends ColumnEncoding

Linear Supertypes
ColumnEncoding, AnyRef, Any
Known Subclasses
BigDictionaryDecoder, BigDictionaryDecoderBase, BigDictionaryDecoderNullable, BooleanBitSetDecoder, BooleanBitSetDecoderBase, BooleanBitSetDecoderNullable, DictionaryDecoder, DictionaryDecoderBase, DictionaryDecoderNullable, NotNullDecoder, NullableDecoder, ResultSetDecoder, RunLengthDecoder, RunLengthDecoderBase, RunLengthDecoderNullable, UncompressedDecoder, UncompressedDecoderBase, UncompressedDecoderNullable, UnsafeRowDecoder
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ColumnDecoder
  2. ColumnEncoding
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ColumnDecoder(columnDataRef: AnyRef, startCursor: Long, field: StructField, initDelta: (AnyRef, Long) ⇒ Long = ColumnEncoding.identityLong)

    Permalink

Abstract Value Members

  1. abstract def findNextNullPosition(columnBytes: AnyRef, nextNullPosition: Int, num: Int): Int

    Permalink

    Fetch next null position and return it as returned by getNextNullPosition.

  2. abstract def getNextNullPosition: Int

    Permalink

    Return the next position of a null value.

  3. abstract def hasNulls: Boolean

    Permalink
    Attributes
    protected[org.apache.spark.sql]

  4. abstract def initializeCursor(columnBytes: AnyRef, cursor: Long, dataType: DataType): Long

    Permalink
    Attributes
    protected[org.apache.spark.sql]

  5. abstract def initializeNulls(columnBytes: AnyRef, startCursor: Long, field: StructField): Long

    Permalink
    Attributes
    protected[org.apache.spark.sql]

  6. abstract def isNullAt(columnBytes: AnyRef, position: Int): Boolean

    Permalink

    Absolute position null check for random access.

  7. abstract def numNulls(columnBytes: AnyRef, ordinal: Int, num: Int): Int

    Permalink

    Return the number of nulls till given ordinal given previous result.

  8. abstract def supports(dataType: DataType): Boolean

    Permalink
    Definition Classes
    ColumnEncoding

  9. abstract def typeId: Int

    Permalink
    Definition Classes
    ColumnEncoding

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. final val baseCursor: Long

    Permalink
    Attributes
    protected[org.apache.spark.sql]

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  7. def close(): Unit

    Permalink

    Close and relinquish all resources of this encoder.

    Close and relinquish all resources of this encoder. The encoder may no longer be usable after this call.

  8. final var currentCursor: Long

    Permalink

    Used by some decoders to track the current sequential cursor.

    Used by some decoders to track the current sequential cursor.

    Attributes
    protected

  9. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  10. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  11. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  12. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  13. def getStringDictionary: StringDictionary

    Permalink

  14. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  15. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  16. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  17. final var nonNullPosition: Int

    Permalink

    Not used by decoders themselves but by delta writer that stores the current nonNullPosition for the decoder.

    Not used by decoders themselves but by delta writer that stores the current nonNullPosition for the decoder. Initialized to -1 so that first increment starts at 0.

    Attributes
    protected[org.apache.spark.sql]

  18. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  19. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  20. def readArray(columnBytes: AnyRef, nonNullPosition: Int): ArrayData

    Permalink

  21. def readBinary(columnBytes: AnyRef, nonNullPosition: Int): Array[Byte]

    Permalink

  22. def readBoolean(columnBytes: AnyRef, nonNullPosition: Int): Boolean

    Permalink

  23. def readByte(columnBytes: AnyRef, nonNullPosition: Int): Byte

    Permalink

  24. def readDate(columnBytes: AnyRef, nonNullPosition: Int): Int

    Permalink

  25. def readDecimal(columnBytes: AnyRef, precision: Int, scale: Int, nonNullPosition: Int): Decimal

    Permalink

  26. def readDictionaryIndex(columnBytes: AnyRef, nonNullPosition: Int): Int

    Permalink

  27. def readDouble(columnBytes: AnyRef, nonNullPosition: Int): Double

    Permalink

  28. def readFloat(columnBytes: AnyRef, nonNullPosition: Int): Float

    Permalink

  29. def readInt(columnBytes: AnyRef, nonNullPosition: Int): Int

    Permalink

  30. def readInterval(columnBytes: AnyRef, nonNullPosition: Int): CalendarInterval

    Permalink

  31. def readLong(columnBytes: AnyRef, nonNullPosition: Int): Long

    Permalink

  32. def readLongDecimal(columnBytes: AnyRef, precision: Int, scale: Int, nonNullPosition: Int): Decimal

    Permalink

  33. def readMap(columnBytes: AnyRef, nonNullPosition: Int): MapData

    Permalink

  34. def readShort(columnBytes: AnyRef, nonNullPosition: Int): Short

    Permalink

  35. def readStruct(columnBytes: AnyRef, numFields: Int, nonNullPosition: Int): InternalRow

    Permalink

  36. def readTimestamp(columnBytes: AnyRef, nonNullPosition: Int): Long

    Permalink

  37. def readUTF8String(columnBytes: AnyRef, nonNullPosition: Int): UTF8String

    Permalink

  38. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  39. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  40. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  41. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  42. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from ColumnEncoding

Inherited from AnyRef

Inherited from Any

Ungrouped