Type Members

1.  trait AttributeNameParser extends AnyRef
2.  class CaseInsensitiveMap[T] extends Map[String, T] with Serializable

   Builds a map in which keys are case insensitive.

   Builds a map in which keys are case insensitive. Input map can be accessed for cases where case-sensitive information is required. The primary constructor is marked private to avoid nested case-insensitive map creation, otherwise the keys in the original map will become case-insensitive in this scenario. Note: CaseInsensitiveMap is serializable. However, after transformation, e.g. filterKeys(), it may become not serializable.

3.  sealed trait DateFormatter extends Serializable
4.  trait DateTimeFormatterHelper extends AnyRef
5.  class DefaultDateFormatter extends Iso8601DateFormatter

   The formatter for dates which doesn't require users to specify a pattern.

   The formatter for dates which doesn't require users to specify a pattern. While formatting, it uses the default pattern DateFormatter.defaultPattern. In parsing, it follows the CAST logic in conversion of strings to Catalyst's DateType.

6.  class DefaultTimestampFormatter extends Iso8601TimestampFormatter

   The formatter for timestamps which doesn't require users to specify a pattern.

   The formatter for timestamps which doesn't require users to specify a pattern. While formatting, it uses the default pattern TimestampFormatter.defaultPattern(). In parsing, it follows the CAST logic in conversion of strings to Catalyst's TimestampType.

7.  class FractionTimestampFormatter extends Iso8601TimestampFormatter

   The formatter parses/formats timestamps according to the pattern yyyy-MM-dd HH:mm:ss.[..fff..] where [..fff..] is a fraction of second up to microsecond resolution.

   The formatter parses/formats timestamps according to the pattern yyyy-MM-dd HH:mm:ss.[..fff..] where [..fff..] is a fraction of second up to microsecond resolution. The formatter does not output trailing zeros in the fraction. For example, the timestamp 2019-03-05 15:00:01.123400 is formatted as the string 2019-03-05 15:00:01.1234.

8.  class Iso8601DateFormatter extends DateFormatter with DateTimeFormatterHelper
9.  class Iso8601TimestampFormatter extends TimestampFormatter with DateTimeFormatterHelper
10.  trait LegacyDateFormatter extends DateFormatter
11.  class LegacyFastDateFormatter extends LegacyDateFormatter

    The legacy formatter is based on Apache Commons FastDateFormat.

    The legacy formatter is based on Apache Commons FastDateFormat. The formatter uses the default JVM time zone intentionally for compatibility with Spark 2.4 and earlier versions.

    Note: Using of the default JVM time zone makes the formatter compatible with the legacy SparkDateTimeUtils methods toJavaDate and fromJavaDate that are based on the default JVM time zone too.

12.  class LegacyFastTimestampFormatter extends TimestampFormatter
13.  class LegacySimpleDateFormatter extends LegacyDateFormatter

    The legacy formatter is based on java.text.SimpleDateFormat.

    The legacy formatter is based on java.text.SimpleDateFormat. The formatter uses the default JVM time zone intentionally for compatibility with Spark 2.4 and earlier versions.

    Note: Using of the default JVM time zone makes the formatter compatible with the legacy SparkDateTimeUtils methods toJavaDate and fromJavaDate that are based on the default JVM time zone too.

14.  class LegacySimpleTimestampFormatter extends TimestampFormatter
15.  class MicrosCalendar extends GregorianCalendar

    The custom sub-class of GregorianCalendar is needed to get access to protected fields immediately after parsing.

    The custom sub-class of GregorianCalendar is needed to get access to protected fields immediately after parsing. We cannot use the get() method because it performs normalization of the fraction part. Accordingly, the MILLISECOND field doesn't contain original value.

    Also this class allows to set raw value to the MILLISECOND field directly before formatting.

16.  trait ResolveDefaultColumnsUtils extends AnyRef
17.  trait SparkCharVarcharUtils extends AnyRef
18.  trait SparkDateTimeUtils extends AnyRef
19.  trait SparkIntervalUtils extends AnyRef
20.  trait SparkParserUtils extends AnyRef
21.  class StringConcat extends AnyRef

    Concatenation of sequence of strings to final string with cheap append method and one memory allocation for the final string.

    Concatenation of sequence of strings to final string with cheap append method and one memory allocation for the final string. Can also bound the final size of the string.

22.  sealed trait TimestampFormatter extends Serializable