Class

com.ebiznext.comet.job.ingest.MetricRecord

AsSql

Related Doc: package MetricRecord

Permalink

case class AsSql(domain: String, schema: String, attribute: String, min: Option[Long], max: Option[Long], mean: Option[Double], missingValues: Option[Long], standardDev: Option[Double], variance: Option[Double], sum: Option[Long], skewness: Option[Double], kurtosis: Option[Long], percentile25: Option[Long], median: Option[Long], percentile75: Option[Long], countDistinct: Option[Long], catCountFreq: Option[String], missingValuesDiscrete: Option[Long], count: Long, cometTime: Long, cometStage: String) extends Product with Serializable

An SQL-side "avatar" for MetricRecord

MetricRecord uses field types that are not directly representable in typical SQL files from Spark (no Spark-compatible SQL dialect has maps, and only Postgres has at least some arrays but not quite enough for what we need. This isn't quite enough)

This record maps these to the corresponding SQL-compatible representation

Note on Postgres: Postgres has a JSON data type. We suggest sticking to String/Varchar for the SQL interface, and having the String-to-JSON conversions happen on the database side IF we have a use case for SQL queries by a specific attribute of these JSON trees (as of writing this, I have a hunch there could be, but WAGNI until proven otherwise -- cchepelov)

Linear Supertypes
Serializable, Serializable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. AsSql
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new AsSql(domain: String, schema: String, attribute: String, min: Option[Long], max: Option[Long], mean: Option[Double], missingValues: Option[Long], standardDev: Option[Double], variance: Option[Double], sum: Option[Long], skewness: Option[Double], kurtosis: Option[Long], percentile25: Option[Long], median: Option[Long], percentile75: Option[Long], countDistinct: Option[Long], catCountFreq: Option[String], missingValuesDiscrete: Option[Long], count: Long, cometTime: Long, cometStage: String)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. val attribute: String

    Permalink
  6. val catCountFreq: Option[String]

    Permalink
  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. val cometStage: String

    Permalink
  9. val cometTime: Long

    Permalink
  10. val count: Long

    Permalink
  11. val countDistinct: Option[Long]

    Permalink
  12. val domain: String

    Permalink
  13. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  14. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  15. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  16. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  17. val kurtosis: Option[Long]

    Permalink
  18. val max: Option[Long]

    Permalink
  19. val mean: Option[Double]

    Permalink
  20. val median: Option[Long]

    Permalink
  21. val min: Option[Long]

    Permalink
  22. val missingValues: Option[Long]

    Permalink
  23. val missingValuesDiscrete: Option[Long]

    Permalink
  24. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  25. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  26. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  27. val percentile25: Option[Long]

    Permalink
  28. val percentile75: Option[Long]

    Permalink
  29. val schema: String

    Permalink
  30. val skewness: Option[Double]

    Permalink
  31. val standardDev: Option[Double]

    Permalink
  32. val sum: Option[Long]

    Permalink
  33. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  34. val variance: Option[Double]

    Permalink
  35. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  36. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  37. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped