object RebaseDateTime

The collection of functions for rebasing days and microseconds from/to the hybrid calendar (Julian + Gregorian since 1582-10-15) which is used by Spark 2.4 and earlier versions to/from Proleptic Gregorian calendar which is used by Spark since version 3.0. See SPARK-26651.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. RebaseDateTime
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Type Members

  1. case class RebaseSpec(mode: internal.LegacyBehaviorPolicy.Value, originTimeZone: Option[String] = None) extends Product with Serializable

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  8. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  9. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  10. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  11. final val lastSwitchGregorianDay: Int
  12. final val lastSwitchGregorianTs: Long
  13. final val lastSwitchJulianDay: Int
  14. final val lastSwitchJulianTs: Long
  15. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  16. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  17. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  18. def rebaseGregorianToJulianDays(days: Int): Int

    An optimized version of localRebaseGregorianToJulianDays(Int).

    An optimized version of localRebaseGregorianToJulianDays(Int). This method leverages the pre-calculated rebasing array to save calculation. For dates of Before Common Era, the function falls back to the regular unoptimized version.

    days

    The number of days since the epoch in Gregorian calendar. It can be negative.

    returns

    The rebased number of days since the epoch in Julian calendar.

  19. def rebaseGregorianToJulianMicros(micros: Long): Long

    An optimized version of Long).

    An optimized version of Long). This method leverages the pre-calculated rebasing maps to save calculation. If the rebasing map doesn't contain information about the current JVM system time zone or micros is related to Before Common Era, the function falls back to the regular unoptimized version.

    Note: The function assumes that the input micros was derived from a local timestamp at the default system JVM time zone in Proleptic Gregorian calendar.

    micros

    The number of microseconds since the epoch '1970-01-01T00:00:00Z' in Proleptic Gregorian calendar. It can be negative.

    returns

    The rebased microseconds since the epoch in Julian calendar.

  20. def rebaseGregorianToJulianMicros(timeZoneId: String, micros: Long): Long

    An optimized version of Long).

    An optimized version of Long). This method leverages the pre-calculated rebasing maps to save calculation. If the rebasing map doesn't contain information about the given time zone timeZoneId or micros is related to Before Common Era, the function falls back to the regular unoptimized version.

    timeZoneId

    A string identifier of a time zone.

    micros

    The number of microseconds since the epoch '1970-01-01T00:00:00Z' in Proleptic Gregorian calendar. It can be negative.

    returns

    The rebased microseconds since the epoch in Julian calendar.

  21. def rebaseJulianToGregorianDays(days: Int): Int

    An optimized version of localRebaseJulianToGregorianDays(Int).

    An optimized version of localRebaseJulianToGregorianDays(Int). This method leverages the pre-calculated rebasing array to save calculation. For dates of Before Common Era, the function falls back to the regular unoptimized version.

    days

    The number of days since the epoch in Julian calendar. It can be negative.

    returns

    The rebased number of days in Gregorian calendar.

  22. def rebaseJulianToGregorianMicros(micros: Long): Long

    An optimized version of Long).

    An optimized version of Long). This method leverages the pre-calculated rebasing maps to save calculation. If the rebasing map doesn't contain information about the current JVM system time zone or micros is related to Before Common Era, the function falls back to the regular unoptimized version.

    Note: The function assumes that the input micros was derived from a local timestamp at the default system JVM time zone in the Julian calendar.

    micros

    The number of microseconds since the epoch '1970-01-01T00:00:00Z' in the Julian calendar. It can be negative.

    returns

    The rebased microseconds since the epoch in Proleptic Gregorian calendar.

  23. def rebaseJulianToGregorianMicros(timeZoneId: String, micros: Long): Long

    An optimized version of Long).

    An optimized version of Long). This method leverages the pre-calculated rebasing maps to save calculation. If the rebasing map doesn't contain information about the given time zone timeZoneId or micros is related to Before Common Era, the function falls back to the regular unoptimized version.

    timeZoneId

    A string identifier of a time zone.

    micros

    The number of microseconds since the epoch '1970-01-01T00:00:00Z' in the Julian calendar. It can be negative.

    returns

    The rebased microseconds since the epoch in Proleptic Gregorian calendar.

  24. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  25. def toString(): String
    Definition Classes
    AnyRef → Any
  26. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  27. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  28. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from AnyRef

Inherited from Any

Ungrouped