Class

com.databricks.labs.automl.model.tools

PostModelingOptimization

Related Doc: package tools

Permalink

class PostModelingOptimization extends Defaults with ModelConfigGenerators with SparkSessionWrapper

Linear Supertypes
SparkSessionWrapper, Serializable, Serializable, ModelConfigGenerators, SeedGenerator, Defaults, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. PostModelingOptimization
  2. SparkSessionWrapper
  3. Serializable
  4. Serializable
  5. ModelConfigGenerators
  6. SeedGenerator
  7. Defaults
  8. AnyRef
  9. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new PostModelingOptimization()

    Permalink

Type Members

  1. case class MLPCModelingConfig(layerCount: Int, layers: Array[Int], maxIter: Int, solver: String, stepSize: Double, tolerance: Double, hiddenLayerSizeAdjust: Int) extends Product with Serializable

    Permalink
    Definition Classes
    ModelConfigGenerators

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final val _allowableEvolutionStrategies: List[String]

    Permalink
    Definition Classes
    Defaults
  5. final val _allowableInitialGenerationIndexMixingModes: List[String]

    Permalink
    Definition Classes
    Defaults
  6. final val _allowableInitialGenerationModes: List[String]

    Permalink
    Definition Classes
    Defaults
  7. final val _allowableMlFlowLoggingModes: List[String]

    Permalink
    Definition Classes
    Defaults
  8. final val _allowableNAFillModes: List[String]

    Permalink
    Definition Classes
    Defaults
  9. def _covarianceConfigDefaults: CovarianceConfig

    Permalink
    Definition Classes
    Defaults
  10. def _dataPrepConfigDefaults: DataPrepConfig

    Permalink
    Definition Classes
    Defaults
  11. def _defaultAutoStoppingFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  12. def _defaultAutoStoppingScore: Double

    Permalink
    Definition Classes
    Defaults
  13. def _defaultCovarianceFilterFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  14. def _defaultDataPrepCachingFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  15. def _defaultDataPrepParallelism: Int

    Permalink
    Definition Classes
    Defaults
  16. def _defaultDataReductionFactor: Double

    Permalink
    Definition Classes
    Defaults
  17. def _defaultDateTimeConversionType: String

    Permalink
    Definition Classes
    Defaults
  18. def _defaultFeatureImportanceCutoffType: String

    Permalink
    Definition Classes
    Defaults
  19. def _defaultFeatureImportanceCutoffValue: Double

    Permalink
    Definition Classes
    Defaults
  20. def _defaultFeatureInteractionConfig: FeatureInteractionConfig

    Permalink
    Definition Classes
    Defaults
  21. def _defaultFeatureInteractionFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  22. def _defaultFeaturesCol: String

    Permalink
    Definition Classes
    Defaults
  23. def _defaultFieldsToIgnoreInVector: Array[String]

    Permalink
    Definition Classes
    Defaults
  24. def _defaultFirstGenerationConfig: FirstGenerationConfig

    Permalink
    Definition Classes
    Defaults
  25. def _defaultHyperSpaceInference: Boolean

    Permalink
    Definition Classes
    Defaults
  26. def _defaultHyperSpaceInferenceCount: Int

    Permalink
    Definition Classes
    Defaults
  27. def _defaultHyperSpaceModelCount: Int

    Permalink
    Definition Classes
    Defaults
  28. def _defaultHyperSpaceModelType: String

    Permalink
    Definition Classes
    Defaults
  29. def _defaultInitialGenerationMode: String

    Permalink
    Definition Classes
    Defaults
  30. def _defaultKSampleConfig: KSampleConfig

    Permalink
    Definition Classes
    Defaults
  31. def _defaultLabelCol: String

    Permalink
    Definition Classes
    Defaults
  32. def _defaultMlFlowArtifactsFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  33. def _defaultMlFlowLoggingFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  34. def _defaultModelingFamily: String

    Permalink
    Definition Classes
    Defaults
  35. def _defaultNAFillFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  36. def _defaultOneHotEncodeFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  37. def _defaultOutlierFilterFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  38. def _defaultPearsonFilterFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  39. def _defaultPipelineDebugFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  40. def _defaultPipelineId: String

    Permalink
    Definition Classes
    Defaults
  41. def _defaultScalingFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  42. def _defaultVarianceFilterFlag: Boolean

    Permalink
    Definition Classes
    Defaults
  43. def _featureImportancesDefaults: MainConfig

    Permalink
    Definition Classes
    Defaults
  44. def _fillConfigDefaults: FillConfig

    Permalink
    Definition Classes
    Defaults
  45. def _gbtDefaultNumBoundaries: Map[String, (Double, Double)]

    Permalink
    Definition Classes
    Defaults
  46. def _gbtDefaultStringBoundaries: Map[String, List[String]]

    Permalink
    Definition Classes
    Defaults
  47. def _geneticTunerDefaults: GeneticConfig

    Permalink
    Definition Classes
    Defaults
  48. var _hyperParameterSpaceCount: Int

    Permalink
  49. def _inferenceConfigSaveLocationDefault: String

    Permalink
    Definition Classes
    Defaults
  50. def _lightGBMDefaultNumBoundaries: Map[String, (Double, Double)]

    Permalink
    Definition Classes
    Defaults
  51. def _lightGBMDefaultStringBoundaries: Map[String, List[String]]

    Permalink
    Definition Classes
    Defaults
  52. def _linearRegressionDefaultNumBoundaries: Map[String, (Double, Double)]

    Permalink
    Definition Classes
    Defaults
  53. def _linearRegressionDefaultStringBoundaries: Map[String, List[String]]

    Permalink
    Definition Classes
    Defaults
  54. def _logisticRegressionDefaultNumBoundaries: Map[String, (Double, Double)]

    Permalink
    Definition Classes
    Defaults
  55. def _logisticRegressionDefaultStringBoundaries: Map[String, List[String]]

    Permalink
    Definition Classes
    Defaults
  56. def _mainConfigDefaults: MainConfig

    Permalink
    Definition Classes
    Defaults
  57. def _mlFlowConfigDefaults: MLFlowConfig

    Permalink
    Definition Classes
    Defaults
  58. def _mlpcDefaultNumBoundaries: Map[String, (Double, Double)]

    Permalink
    Definition Classes
    Defaults
  59. def _mlpcDefaultStringBoundaries: Map[String, List[String]]

    Permalink
    Definition Classes
    Defaults
  60. var _modelFamily: String

    Permalink
  61. var _modelType: String

    Permalink
  62. def _modelTypeDefault: String

    Permalink
    Definition Classes
    Defaults
  63. def _naiveBayesDefaultNumBoundaries: Map[String, (Double, Double)]

    Permalink
    Definition Classes
    Defaults
  64. def _naiveBayesDefaultStringBoundaries: Map[String, List[String]]

    Permalink
    Definition Classes
    Defaults
  65. var _numericBoundaries: Map[String, (Double, Double)]

    Permalink
  66. var _optimizationStrategy: String

    Permalink
  67. def _outlierConfigDefaults: OutlierConfig

    Permalink
    Definition Classes
    Defaults
  68. def _pearsonConfigDefaults: PearsonConfig

    Permalink
    Definition Classes
    Defaults
  69. def _rfDefaultNumBoundaries: Map[String, (Double, Double)]

    Permalink
    Definition Classes
    Defaults
  70. def _rfDefaultStringBoundaries: Map[String, List[String]]

    Permalink
    Definition Classes
    Defaults
  71. def _scalingConfigDefaults: ScalingConfig

    Permalink
    Definition Classes
    Defaults
  72. def _scoringDefaultClassifier: String

    Permalink
    Definition Classes
    Defaults
  73. def _scoringDefaultRegressor: String

    Permalink
    Definition Classes
    Defaults
  74. def _scoringOptimizationStrategyClassifier: String

    Permalink
    Definition Classes
    Defaults
  75. def _scoringOptimizationStrategyRegressor: String

    Permalink
    Definition Classes
    Defaults
  76. var _seed: Long

    Permalink
  77. var _stringBoundaries: Map[String, List[String]]

    Permalink
  78. final val _supportedFeatureImportanceCutoffTypes: List[String]

    Permalink
    Definition Classes
    Defaults
  79. final val _supportedModels: Array[String]

    Permalink
    Definition Classes
    Defaults
  80. def _svmDefaultNumBoundaries: Map[String, (Double, Double)]

    Permalink
    Definition Classes
    Defaults
  81. def _svmDefaultStringBoundaries: Map[String, List[String]]

    Permalink
    Definition Classes
    Defaults
  82. def _treeSplitDefaults: MainConfig

    Permalink
    Definition Classes
    Defaults
  83. def _treesDefaultNumBoundaries: Map[String, (Double, Double)]

    Permalink
    Definition Classes
    Defaults
  84. def _treesDefaultStringBoundaries: Map[String, List[String]]

    Permalink
    Definition Classes
    Defaults
  85. def _xgboostDefaultNumBoundaries: Map[String, (Double, Double)]

    Permalink
    Definition Classes
    Defaults
  86. final val allowableCardinalilties: List[String]

    Permalink
    Definition Classes
    Defaults
  87. final val allowableCategoricalFilterModes: List[String]

    Permalink
    Definition Classes
    Defaults
  88. final val allowableDateTimeConversions: List[String]

    Permalink
    Definition Classes
    Defaults
  89. final val allowableFeatureInteractionModes: List[String]

    Permalink
    Definition Classes
    Defaults
  90. final val allowableKMeansDistanceMeasurements: List[String]

    Permalink
    Definition Classes
    Defaults
  91. final val allowableLabelBalanceModes: List[String]

    Permalink
    Definition Classes
    Defaults
  92. final val allowableMBORegressorTypes: List[String]

    Permalink
    Definition Classes
    Defaults
  93. final val allowableMutationModes: List[String]

    Permalink
    Definition Classes
    Defaults
  94. final val allowableVectorMutationMethods: List[String]

    Permalink
    Definition Classes
    Defaults
  95. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  96. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  97. def convertGBTResultToConfig(predictionDataFrame: DataFrame): Array[GBTConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  98. def convertLightGBMResultToConfig(predictionDataFrame: DataFrame): Array[LightGBMConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  99. def convertLinearRegressionResultToConfig(predictionDataFrame: DataFrame): Array[LinearRegressionConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  100. def convertLogisticRegressionResultToConfig(predictionDataFrame: DataFrame): Array[LogisticRegressionConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  101. def convertMLPCResultToConfig(predictionDataFrame: DataFrame, inputFeatureSize: Int, distinctClasses: Int): Array[MLPCConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  102. def convertRandomForestResultToConfig(predictionDataFrame: DataFrame): Array[RandomForestConfig]

    Permalink

    Helper method for converting a Dataframe of predicted hyper parameters into configurations that can be used by models (for post-run hyper parameter optimization)

    Helper method for converting a Dataframe of predicted hyper parameters into configurations that can be used by models (for post-run hyper parameter optimization)

    predictionDataFrame

    The predicted sets of highest probability hyper parameter collections

    returns

    An Array of RandomForest Configurations to be used in generating model runs.

    Definition Classes
    ModelConfigGenerators
  103. def convertSVMResultToConfig(predictionDataFrame: DataFrame): Array[SVMConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  104. def convertToLog(minScale: Double, maxScale: Double, value: Double): Double

    Permalink
    Definition Classes
    SeedGenerator
  105. def convertTreesResultToConfig(predictionDataFrame: DataFrame): Array[TreesConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  106. def convertXGBoostResultToConfig(predictionDataFrame: DataFrame): Array[XGBoostConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  107. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  108. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  109. def extractContinuousBoundaries(parameter: (Double, Double)): NumericBoundaries

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    SeedGenerator
  110. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  111. def gbtConfigGenerator(gbtPermutationCollection: GBTPermutationCollection): Array[GBTConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  112. def gbtNumericArrayGenerator(config: PermutationConfiguration): GBTNumericArrays

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    ModelConfigGenerators
  113. def gbtPermutationGenerator(config: PermutationConfiguration, countTarget: Int, seed: Long = 42L): Array[GBTConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  114. def gbtPrediction(modelingResults: Array[GenericModelReturn], modelType: String, topPredictions: Int): Array[GBTConfig]

    Permalink
  115. def gbtResultMapping(results: Array[GenericModelReturn]): DataFrame

    Permalink
  116. def generateArraySpace(layerBoundaryLow: Int, layerBoundaryHigh: Int, hiddenBoundaryLow: Int, hiddenBoundaryHigh: Int, inputFeatureSize: Int, distinctClasses: Int, generatorCount: Int): Array[Array[Int]]

    Permalink
    Definition Classes
    SeedGenerator
  117. def generateGBTSearchSpace(): Array[GBTConfig]

    Permalink
  118. def generateGBTSearchSpaceAsDataFrame(): DataFrame

    Permalink
  119. def generateLightGBMSearchSpace(): Array[LightGBMConfig]

    Permalink
  120. def generateLightGBMSearchSpaceAsDataFrame(): DataFrame

    Permalink
  121. def generateLinearIntSpace(boundaries: NumericBoundaries, generatorCount: Int): Array[Double]

    Permalink
    Definition Classes
    SeedGenerator
  122. def generateLinearRegressionSearchSpace(): Array[LinearRegressionConfig]

    Permalink
  123. def generateLinearRegressionSearchSpaceAsDataFrame(): DataFrame

    Permalink
  124. def generateLinearSpace(boundaries: NumericBoundaries, generatorCount: Int): Array[Double]

    Permalink
    Definition Classes
    SeedGenerator
  125. def generateLogSpace(boundaries: NumericBoundaries, generatorCount: Int): Array[Double]

    Permalink
    Definition Classes
    SeedGenerator
  126. def generateLogisticRegressionSearchSpace(): Array[LogisticRegressionConfig]

    Permalink
  127. def generateLogisticRegressionSearchSpaceAsDataFrame(): DataFrame

    Permalink
  128. def generateMLPCSearchSpace(inputFeatureSize: Int, classCount: Int): Array[MLPCModelingConfig]

    Permalink
  129. def generateMLPCSearchSpaceAsDataFrame(inputFeatureSize: Int, classCount: Int): DataFrame

    Permalink
  130. def generateRandomForestSearchSpace(): Array[RandomForestConfig]

    Permalink

    Generates an array of RandomForestConfig hyper parameters to meet the configured target size

    Generates an array of RandomForestConfig hyper parameters to meet the configured target size

    returns

    a distinct array of RandomForestConfig's

    Attributes
    protected[com.databricks.labs.automl.model.tools]
  131. def generateRandomForestSearchSpaceAsDataFrame(): DataFrame

    Permalink
  132. def generateSVMSearchSpace(): Array[SVMConfig]

    Permalink
  133. def generateSVMSearchSpaceAsDataFrame(): DataFrame

    Permalink
  134. def generateTreesSearchSpace(): Array[TreesConfig]

    Permalink
  135. def generateTreesSearchSpaceAsDataFrame(): DataFrame

    Permalink
  136. def generateXGBoostSearchSpace(): Array[XGBoostConfig]

    Permalink
  137. def generateXGBoostSearchSpaceAsDataFrame(): DataFrame

    Permalink
  138. def getCaseClassNames[T](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[T]): List[String]

    Permalink

    Helper method for reading a case class definition, getting the defined names of each key, and returning them as an iterable list.

    Helper method for reading a case class definition, getting the defined names of each key, and returning them as an iterable list.

    T

    The class type as derived through reflection

    returns

    The List of all case class member names

    Definition Classes
    ModelConfigGenerators
  139. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  140. def getHyperParameterSpaceCount: Int

    Permalink
  141. def getModelFamily: String

    Permalink
  142. def getModelType: String

    Permalink
  143. def getNumberOfElements(numericBoundaries: Map[String, (Double, Double)]): Int

    Permalink
    Definition Classes
    SeedGenerator
  144. def getNumericBoundaries: Map[String, (Double, Double)]

    Permalink
  145. def getOptimizationStrategy: String

    Permalink
  146. def getPermutationCounts(targetIterations: Int, numberOfElements: Int): Int

    Permalink
    Definition Classes
    SeedGenerator
  147. def getSeed: Long

    Permalink
  148. def getStringBoundaries: Map[String, List[String]]

    Permalink
  149. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  150. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  151. def lightGBMConfigGenerator(lightGBMPermutationCollection: LightGBMPermutationCollection): Array[LightGBMConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  152. def lightGBMNumericArrayGenerator(config: PermutationConfiguration): LightGBMNumericArrays

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    ModelConfigGenerators
  153. def lightGBMPermutationGenerator(config: PermutationConfiguration, countTarget: Int, seed: Long = 42L): Array[LightGBMConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  154. def lightGBMPrediction(modelingResults: Array[GenericModelReturn], modelType: String, topPredictions: Int): Array[LightGBMConfig]

    Permalink
  155. def lightGBMResultMapping(results: Array[GenericModelReturn]): DataFrame

    Permalink
  156. def linearRegressionConfigGenerator(linearRegressionPermutationCollection: LinearRegressionPermutationCollection): Array[LinearRegressionConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  157. def linearRegressionNumericArrayGenerator(config: PermutationConfiguration): LinearRegressionNumericArrays

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    ModelConfigGenerators
  158. def linearRegressionPermutationGenerator(config: PermutationConfiguration, countTarget: Int, seed: Long = 42L): Array[LinearRegressionConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  159. def linearRegressionPrediction(modelingResults: Array[GenericModelReturn], modelType: String, topPredictions: Int): Array[LinearRegressionConfig]

    Permalink
  160. def linearRegressionResultMapping(results: Array[GenericModelReturn]): DataFrame

    Permalink
  161. def logisticRegressionConfigGenerator(logisticRegressionPermutationCollection: LogisticRegressionPermutationCollection): Array[LogisticRegressionConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  162. def logisticRegressionNumericArrayGenerator(config: PermutationConfiguration): LogisticRegressionNumericArrays

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    ModelConfigGenerators
  163. def logisticRegressionPermutationGenerator(config: PermutationConfiguration, countTarget: Int, seed: Long = 42L): Array[LogisticRegressionConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  164. def logisticRegressionPrediction(modelingResults: Array[GenericModelReturn], modelType: String, topPredictions: Int): Array[LogisticRegressionConfig]

    Permalink
  165. def logisticRegressionResultMapping(results: Array[GenericModelReturn]): DataFrame

    Permalink
  166. def mlpcConfigGenerator(mlpcPermutationCollection: MLPCPermutationCollection): Array[MLPCModelingConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  167. def mlpcLayersExtractor(layers: Array[Int]): (Int, Int)

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    SeedGenerator
  168. def mlpcNumericArrayGenerator(config: MLPCPermutationConfiguration): MLPCNumericArrays

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    ModelConfigGenerators
  169. def mlpcPermutationGenerator(config: MLPCPermutationConfiguration, countTarget: Int, seed: Long = 42L): Array[MLPCModelingConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  170. def mlpcPrediction(modelingResults: Array[GenericModelReturn], modelType: String, topPredictions: Int, featureInputSize: Int, classDistinctCount: Int): Array[MLPCConfig]

    Permalink
  171. def mlpcRandomIndexSelection(numericArrays: MLPCNumericArrays): MLPCArrayCollection

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    SeedGenerator
  172. def mlpcResultMapping(results: Array[GenericModelReturn]): DataFrame

    Permalink
  173. def mlpcStaticIndexSelection(numericArrays: MLPCNumericArrays): MLPCArrayCollection

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    SeedGenerator
  174. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  175. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  176. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  177. def randomForestConfigGenerator(randomForestPermutationCollection: RandomForestPermutationCollection): Array[RandomForestConfig]

    Permalink

    Method for taking a collection of permutations generated per each hyper parameter and converting them into a collection that can be used to execute models by building out all possible permutations of the generated hyper parameter collections.

    Method for taking a collection of permutations generated per each hyper parameter and converting them into a collection that can be used to execute models by building out all possible permutations of the generated hyper parameter collections.

    randomForestPermutationCollection

    The Array of values generated for possible hyper parameters for the permutation collection creation

    returns

    Array of Random Forest configurations based on permutations of each value within the arrays supplied.

    Definition Classes
    ModelConfigGenerators
  178. def randomForestNumericArrayGenerator(config: PermutationConfiguration): RandomForestNumericArrays

    Permalink

    Method for generating linear and log spaces for potential hyper parameter values for the model

    Method for generating linear and log spaces for potential hyper parameter values for the model

    config

    Configuration value for the generation of permutation arrays

    returns

    Arrays for all numeric parameters that will be generated for input into the permutation generator

    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    ModelConfigGenerators
  179. def randomForestPermutationGenerator(config: PermutationConfiguration, countTarget: Int, seed: Long = 42L): Array[RandomForestConfig]

    Permalink

    Main accessor for generating permutations for a RandomForest Model

    Main accessor for generating permutations for a RandomForest Model

    config

    Configuration for holding the numeber of permutations to generate and the boundaries of the search space

    countTarget

    Total maximum count of permutations to return

    seed

    Seed for determining the random sample of permutations that are generated due to the sheer count of permutations that are generated to search the space effectively.

    returns

    An Array of RandomForest Configurations to be used in generating model runs.

    Definition Classes
    ModelConfigGenerators
  180. def randomForestPrediction(modelingResults: Array[GenericModelReturn], modelType: String, topPredictions: Int): Array[RandomForestConfig]

    Permalink
  181. def randomForestResultMapping(results: Array[GenericModelReturn]): DataFrame

    Permalink
  182. def randomIndexSelection(numericArrays: Array[Array[Double]]): NumericArrayCollection

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    SeedGenerator
  183. def randomSampleArray[T](hyperParameterArray: Array[T], sampleCount: Int, seed: Long = 42L)(implicit arg0: ClassTag[T]): Array[T]

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    SeedGenerator
  184. lazy val sc: SparkContext

    Permalink
    Definition Classes
    SparkSessionWrapper
  185. def selectCoinFlip(currentIterator: Int): Boolean

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    SeedGenerator
  186. def selectStringIndex(availableParams: List[String], currentIterator: Int): StringSelectionReturn

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    SeedGenerator
  187. def setHyperParameterSpaceCount(value: Int): PostModelingOptimization.this.type

    Permalink
  188. def setModelFamily(value: String): PostModelingOptimization.this.type

    Permalink
  189. def setModelType(value: String): PostModelingOptimization.this.type

    Permalink
  190. def setNumericBoundaries(value: Map[String, (Double, Double)]): PostModelingOptimization.this.type

    Permalink
  191. def setOptimizationStrategy(value: String): PostModelingOptimization.this.type

    Permalink
  192. def setSeed(value: Long): PostModelingOptimization.this.type

    Permalink
  193. def setStringBoundaries(value: Map[String, List[String]]): PostModelingOptimization.this.type

    Permalink
  194. lazy val spark: SparkSession

    Permalink
    Definition Classes
    SparkSessionWrapper
  195. def staticIndexSelection(numericArrays: Array[Array[Double]]): NumericArrayCollection

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    SeedGenerator
  196. def stringBoundaryPermutationCalculator(stringBoundaries: Map[String, List[String]]): Int

    Permalink

    Calculates the number of possible additional permutations to be added to the search space for string values

    Calculates the number of possible additional permutations to be added to the search space for string values

    stringBoundaries

    The string boundary payload for a modeling family

    returns

    Int representing any additional permutations on the numeric body that will need to be generated in order to attempt to reach the target unique hyperparameter search space

    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    SeedGenerator
  197. def svmConfigGenerator(svmPermutationCollection: SVMPermutationCollection): Array[SVMConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  198. def svmNumericArrayGenerator(config: PermutationConfiguration): SVMNumericArrays

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    ModelConfigGenerators
  199. def svmPermutationGenerator(config: PermutationConfiguration, countTarget: Int, seed: Long = 42L): Array[SVMConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  200. def svmPrediction(modelingResults: Array[GenericModelReturn], modelType: String, topPredictions: Int): Array[SVMConfig]

    Permalink
  201. def svmResultMapping(results: Array[GenericModelReturn]): DataFrame

    Permalink
  202. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  203. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  204. final val trainSplitMethods: List[String]

    Permalink
    Definition Classes
    Defaults
  205. def treesConfigGenerator(treesPermutationCollection: TreesPermutationCollection): Array[TreesConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  206. def treesNumericArrayGenerator(config: PermutationConfiguration): TreesNumericArrays

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    ModelConfigGenerators
  207. def treesPermutationGenerator(config: PermutationConfiguration, countTarget: Int, seed: Long = 42L): Array[TreesConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  208. def treesPrediction(modelingResults: Array[GenericModelReturn], modelType: String, topPredictions: Int): Array[TreesConfig]

    Permalink
  209. def treesResultMapping(results: Array[GenericModelReturn]): DataFrame

    Permalink
  210. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  211. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  212. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  213. def xgBoostPrediction(modelingResults: Array[GenericModelReturn], modelType: String, topPredictions: Int): Array[XGBoostConfig]

    Permalink
  214. def xgBoostResultMapping(results: Array[GenericModelReturn]): DataFrame

    Permalink
  215. def xgboostConfigGenerator(xgboostPermutationCollection: XGBoostPermutationCollection): Array[XGBoostConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators
  216. def xgboostNumericArrayGenerator(config: PermutationConfiguration): XGBoostNumericArrays

    Permalink
    Attributes
    protected[com.databricks.labs.automl.model.tools]
    Definition Classes
    ModelConfigGenerators
  217. def xgboostPermutationGenerator(config: PermutationConfiguration, countTarget: Int, seed: Long = 42L): Array[XGBoostConfig]

    Permalink
    Definition Classes
    ModelConfigGenerators

Inherited from SparkSessionWrapper

Inherited from Serializable

Inherited from Serializable

Inherited from ModelConfigGenerators

Inherited from SeedGenerator

Inherited from Defaults

Inherited from AnyRef

Inherited from Any

Ungrouped