Trait

com.databricks.labs.automl.utils

AutomationTools

Related Doc: package utils

Permalink

trait AutomationTools extends SparkSessionWrapper

Linear Supertypes
SparkSessionWrapper, Serializable, Serializable, AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. AutomationTools
  2. SparkSessionWrapper
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. def dataPersist(preDF: DataFrame, postDF: DataFrame, cacheLevel: StorageLevel, blockUnpersist: Boolean): (DataFrame, String)

    Permalink
  7. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  9. def extractGenerationData(payload: Array[GenericModelReturn]): Map[Int, (Double, Double)]

    Permalink
  10. def extractGenerationalScores(payload: Array[GenericModelReturn], scoringOptimizationStrategy: String, modelFamily: String, modelType: String): Array[GenerationalReport]

    Permalink
  11. def extractMLPCPayload(payload: MLPCConfig): Map[String, Any]

    Permalink
  12. def extractPayload(cc: Product): Map[String, Any]

    Permalink
  13. def fieldRemovalCompare(preFilterFields: Array[String], postFilterFields: Array[String]): List[String]

    Permalink
  14. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  15. def generationDataFrameReport(generationalData: Array[GenerationalReport], sortingStrategy: String): DataFrame

    Permalink
  16. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  17. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  18. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  19. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  20. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  21. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  22. def prettyPrintConfig(config: AnyRef): String

    Permalink

    Provide a human-readable report into stdout and in the logs that show the configuration for a model run with the key -> value relationship shown as json

    Provide a human-readable report into stdout and in the logs that show the configuration for a model run with the key -> value relationship shown as json

    config

    AnyRef -> a defined case class

    returns

    String in the form of pretty print syntax

  23. def printSchema(schema: Array[String], dataName: String): String

    Permalink
  24. def printSchema(df: DataFrame, dataName: String): String

    Permalink
  25. def recordInferenceDataConfig(config: MainConfig, startingFields: Array[String]): InferenceDataConfig

    Permalink

    Helper method for generating the Inference Config object for the data configuration steps needed to perform to reproduce the modeling for subsequent inference runs.

    Helper method for generating the Inference Config object for the data configuration steps needed to perform to reproduce the modeling for subsequent inference runs.

    config

    The full main Config that is utilized for the execution of the run.

    startingFields

    The fields that are are returned from type casting and validation (may contain artificial suffixes for StringIndexer (_si) and OneHotEncoder(_oh). These will be removed before recording.

    returns

    and Instance of InferenceDataConfig

    Since

    0.4.0

  26. def recordInferenceSwitchSettings(config: MainConfig): InferenceSwitchSettings

    Permalink

    Single-pass method for recording all switch settings to the InferenceConfig Object.

    Single-pass method for recording all switch settings to the InferenceConfig Object.

    config

    MainConfig used for starting the training AutoML run

  27. lazy val sc: SparkContext

    Permalink
    Definition Classes
    SparkSessionWrapper
  28. lazy val spark: SparkSession

    Permalink
    Definition Classes
    SparkSessionWrapper
  29. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  30. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  31. def trainSplitValidation(trainSplitMethod: String, modelSelection: String): String

    Permalink
  32. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  33. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  34. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from SparkSessionWrapper

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped