Object

com.nvidia.spark.rapids

GpuBatchUtils

Related Doc: package rapids

Permalink

object GpuBatchUtils

Utility class with methods for calculating various metrics about GPU memory usage prior to allocation.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. GpuBatchUtils
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. val OFFSET_BYTES: Int

    Permalink

    Number of bytes per offset (32 bit)

  5. val VALIDITY_BUFFER_BOUNDARY_BYTES: Int

    Permalink

    Validity buffers are 64 byte aligned

  6. val VALIDITY_BUFFER_BOUNDARY_ROWS: Int

    Permalink

    Validity buffers are 64 byte aligned and each byte represents 8 rows

  7. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  8. def calculateOffsetBufferSize(rows: Long): Long

    Permalink
  9. def calculateValidityBufferSize(rows: Long): Long

    Permalink
  10. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  11. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  13. def estimateGpuMemory(dataType: DataType, nullable: Boolean, rowCount: Long): Long

    Permalink
  14. def estimateGpuMemory(schema: StructType, columnIndex: Int, rowCount: Long): Long

    Permalink

    Estimate the amount of GPU memory a batch of rows will occupy once converted

  15. def estimateGpuMemory(schema: StructType, rowCount: Long): Long

    Permalink

    Estimate the amount of GPU memory a batch of rows will occupy once converted

  16. def estimateRowCount(desiredBatchSizeBytes: Long, currentBatchSize: Long, currentBatchRowCount: Long): Int

    Permalink

    Estimate the number of rows required to meet a batch size limit

  17. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  18. def generateSplitIndices(rows: Long, numSplits: Int): Array[Int]

    Permalink

    Generate indices which evenly splitting input batch

    Generate indices which evenly splitting input batch

    rows

    number of rows of input batch

    numSplits

    desired number of splits

    returns

    splitting indices

  19. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  20. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  21. def isFixedWidth(dt: DataType): Boolean

    Permalink
  22. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  23. def isVariableWidth(dt: DataType): Boolean

    Permalink
  24. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  25. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  26. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  27. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  28. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  29. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped