Class

org.apache.spark.sql.execution.columnar.encoding

ColumnDecoder

Related Doc: package encoding

Permalink

abstract class ColumnDecoder extends ColumnEncoding

Linear Supertypes
ColumnEncoding, AnyRef, Any
Known Subclasses
BigDictionaryDecoder, BigDictionaryDecoderBase, BigDictionaryDecoderNullable, BooleanBitSetDecoder, BooleanBitSetDecoderBase, BooleanBitSetDecoderNullable, DictionaryDecoder, DictionaryDecoderBase, DictionaryDecoderNullable, NotNullDecoder, NullableDecoder, ResultSetDecoder, RunLengthDecoder, RunLengthDecoderBase, RunLengthDecoderNullable, UncompressedDecoder, UncompressedDecoderBase, UncompressedDecoderNullable, UnsafeRowDecoder
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ColumnDecoder
  2. ColumnEncoding
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ColumnDecoder(columnDataRef: AnyRef, startCursor: Long, field: StructField, initDelta: (AnyRef, Long) ⇒ Long = ColumnEncoding.identityLong)

    Permalink

Abstract Value Members

  1. abstract def findNextNullPosition(columnBytes: AnyRef, nextNullPosition: Int, num: Int): Int

    Permalink

    Fetch next null position and return it as returned by getNextNullPosition.

  2. abstract def getNextNullPosition: Int

    Permalink

    Return the next position of a null value.

  3. abstract def hasNulls: Boolean

    Permalink
    Attributes
    protected[org.apache.spark.sql]

  4. abstract def initializeCursor(columnBytes: AnyRef, cursor: Long, dataType: DataType): Long

    Permalink
    Attributes
    protected[org.apache.spark.sql]

  5. abstract def initializeNulls(columnBytes: AnyRef, startCursor: Long, field: StructField): Long

    Permalink
    Attributes
    protected[org.apache.spark.sql]

  6. abstract def isNullAt(columnBytes: AnyRef, position: Int): Boolean

    Permalink

    Absolute position null check for random access.

  7. abstract def numNulls(columnBytes: AnyRef, ordinal: Int, num: Int): Int

    Permalink

    Return the number of nulls till given ordinal given previous result.

  8. abstract def supports(dataType: DataType): Boolean

    Permalink
    Definition Classes
    ColumnEncoding

  9. abstract def typeId: Int

    Permalink
    Definition Classes
    ColumnEncoding

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. final val baseCursor: Long

    Permalink
    Attributes
    protected[org.apache.spark.sql]

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  7. final var currentCursor: Long

    Permalink

    Used by some decoders to track the current sequential cursor.

    Used by some decoders to track the current sequential cursor.

    Attributes
    protected

  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  9. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  12. def getStringDictionary: StringDictionary

    Permalink

  13. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  14. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  15. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  16. final var nonNullPosition: Int

    Permalink

    Not used by decoders themselves but by delta writer that stores the current nonNullPosition for the decoder.

    Not used by decoders themselves but by delta writer that stores the current nonNullPosition for the decoder. Initialized to -1 so that first increment starts at 0.

    Attributes
    protected[org.apache.spark.sql]

  17. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  18. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  19. def readArray(columnBytes: AnyRef, nonNullPosition: Int): ArrayData

    Permalink

  20. def readBinary(columnBytes: AnyRef, nonNullPosition: Int): Array[Byte]

    Permalink

  21. def readBoolean(columnBytes: AnyRef, nonNullPosition: Int): Boolean

    Permalink

  22. def readByte(columnBytes: AnyRef, nonNullPosition: Int): Byte

    Permalink

  23. def readDate(columnBytes: AnyRef, nonNullPosition: Int): Int

    Permalink

  24. def readDecimal(columnBytes: AnyRef, precision: Int, scale: Int, nonNullPosition: Int): Decimal

    Permalink

  25. def readDictionaryIndex(columnBytes: AnyRef, nonNullPosition: Int): Int

    Permalink

  26. def readDouble(columnBytes: AnyRef, nonNullPosition: Int): Double

    Permalink

  27. def readFloat(columnBytes: AnyRef, nonNullPosition: Int): Float

    Permalink

  28. def readInt(columnBytes: AnyRef, nonNullPosition: Int): Int

    Permalink

  29. def readInterval(columnBytes: AnyRef, nonNullPosition: Int): CalendarInterval

    Permalink

  30. def readLong(columnBytes: AnyRef, nonNullPosition: Int): Long

    Permalink

  31. def readLongDecimal(columnBytes: AnyRef, precision: Int, scale: Int, nonNullPosition: Int): Decimal

    Permalink

  32. def readMap(columnBytes: AnyRef, nonNullPosition: Int): MapData

    Permalink

  33. def readShort(columnBytes: AnyRef, nonNullPosition: Int): Short

    Permalink

  34. def readStruct(columnBytes: AnyRef, numFields: Int, nonNullPosition: Int): InternalRow

    Permalink

  35. def readTimestamp(columnBytes: AnyRef, nonNullPosition: Int): Long

    Permalink

  36. def readUTF8String(columnBytes: AnyRef, nonNullPosition: Int): UTF8String

    Permalink

  37. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  38. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  39. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  40. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  41. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from ColumnEncoding

Inherited from AnyRef

Inherited from Any

Ungrouped