org.apache.spark.sql.catalyst.expressions.codegen

CodeGenContext

class CodeGenContext extends AnyRef

A context for codegen, which is used to bookkeeping the expressions those are not supported by codegen, then they are evaluated directly. The unsupported expression is appended at the end of references, the position of it is kept in the code, used to access and evaluate it.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. CodeGenContext
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new CodeGenContext()

Type Members

  1. case class SubExprEliminationState(isNull: String, value: String) extends Product with Serializable

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final val INPUT_ROW: String("i")

    The variable name of the input row in generated code.

  7. final val JAVA_BOOLEAN: String("boolean")

  8. final val JAVA_BYTE: String("byte")

  9. final val JAVA_DOUBLE: String("double")

  10. final val JAVA_FLOAT: String("float")

  11. final val JAVA_INT: String("int")

  12. final val JAVA_LONG: String("long")

  13. final val JAVA_SHORT: String("short")

  14. def addMutableState(javaType: String, variableName: String, initCode: String): Unit

  15. def addNewFunction(funcName: String, funcCode: String): Unit

  16. val addedFunctions: Map[String, String]

    Holding all the functions those will be added into generated class.

  17. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  18. def boxedType(dt: DataType): String

  19. def boxedType(jt: String): String

    Returns the boxed type in Java.

  20. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  21. def defaultValue(dt: DataType): String

  22. def defaultValue(jt: String): String

    Returns the representation of default value for a given Java Type.

  23. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  24. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  25. val equivalentExpressions: EquivalentExpressions

    Holds expressions that are equivalent.

    Holds expressions that are equivalent. Used to perform subexpression elimination during codegen.

    For expressions that appear more than once, generate additional code to prevent recomputing the value.

    For example, consider two exprsesion generated from this SQL statement: SELECT (col1 + col2), (col1 + col2) / col3.

    equivalentExpressions will match the tree containing col1 + col2 and it will only be evaluated once.

  26. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  27. def freshName(prefix: String): String

    Returns a term name that is unique within this instance of a CodeGenerator.

    Returns a term name that is unique within this instance of a CodeGenerator.

    (Since we aren't in a macro context we do not seem to have access to the built in freshName function.)

  28. def genComp(dataType: DataType, c1: String, c2: String): String

    Generates code for comparing two expressions.

    Generates code for comparing two expressions.

    dataType

    data type of the expressions

    c1

    name of the variable of expression 1's output

    c2

    name of the variable of expression 2's output

  29. def genEqual(dataType: DataType, c1: String, c2: String): String

    Generates code for equal expression in Java.

  30. def genGreater(dataType: DataType, c1: String, c2: String): String

    Generates code for greater of two expressions.

    Generates code for greater of two expressions.

    dataType

    data type of the expressions

    c1

    name of the variable of expression 1's output

    c2

    name of the variable of expression 2's output

  31. def generateExpressions(expressions: Seq[Expression], doSubexpressionElimination: Boolean = false): Seq[GeneratedExpressionCode]

    Generates code for expressions.

    Generates code for expressions. If doSubexpressionElimination is true, subexpression elimination will be performed. Subexpression elimination assumes that the code will for each expression will be combined in the expressions order.

  32. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  33. def getValue(input: String, dataType: DataType, ordinal: String): String

    Returns the specialized code to access a value from inputRow at ordinal.

  34. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  35. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  36. def isPrimitiveType(dt: DataType): Boolean

  37. def isPrimitiveType(jt: String): Boolean

    Returns true if the Java type has a special accessor and setter in InternalRow.

  38. def javaType(dt: DataType): String

    Returns the Java type for a DataType.

  39. val mutableStates: ArrayBuffer[(String, String, String)]

    Holding expressions' mutable states like MonotonicallyIncreasingID.count as a 3-tuple: java type, variable name, code to init it.

    Holding expressions' mutable states like MonotonicallyIncreasingID.count as a 3-tuple: java type, variable name, code to init it. As an example, ("int", "count", "count = 0;") will produce code:

    private int count;

    as a member variable, and add

    count = 0;

    to the constructor.

    They will be kept as member variables in generated classes like SpecificProjection.

  40. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  41. final def notify(): Unit

    Definition Classes
    AnyRef

  42. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  43. def primitiveTypeName(dt: DataType): String

  44. def primitiveTypeName(jt: String): String

    Returns the name used in accessor and setter for a Java primitive type.

  45. val primitiveTypes: Seq[String]

    List of java data types that have special accessors and setters in InternalRow.

  46. val references: ArrayBuffer[Expression]

    Holding all the expressions those do not support codegen, will be evaluated directly.

  47. def setColumn(row: String, dataType: DataType, ordinal: Int, value: String): String

    Returns the code to update a column in Row for a given DataType.

  48. def splitExpressions(row: String, expressions: Seq[String]): String

    Splits the generated code of expressions into multiple functions, because function has 64kb code size limit in JVM

    Splits the generated code of expressions into multiple functions, because function has 64kb code size limit in JVM

    row

    the variable name of row that is used by expressions

    expressions

    the codes to evaluate expressions.

  49. val subExprEliminationExprs: HashMap[Expression, SubExprEliminationState]

  50. val subExprResetVariables: ArrayBuffer[String]

  51. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  52. def toString(): String

    Definition Classes
    AnyRef → Any

  53. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  54. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  55. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped