org.apache.spark.ml.odkl.CombinedModel

PerClassModelLearner

abstract class PerClassModelLearner[N <: ModelWithSummary[N], M <: MultiClassCombinationModelBase[N, M]] extends ForkedEstimator[N, String, M] with HasClassesCol with HasClassesWeights with HasLabelCol with HasPredictionCol

Collects all classes in the dataset and trains a model for each class. Base class for multi-class and linear combination model.

Linear Supertypes
HasPredictionCol, HasLabelCol, HasClassesWeights, HasClassesCol, ForkedEstimator[N, String, M], ForkedModelParams, SummarizableEstimator[M], Estimator[M], PipelineStage, Logging, Params, Serializable, Serializable, Identifiable, AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. PerClassModelLearner
  2. HasPredictionCol
  3. HasLabelCol
  4. HasClassesWeights
  5. HasClassesCol
  6. ForkedEstimator
  7. ForkedModelParams
  8. SummarizableEstimator
  9. Estimator
  10. PipelineStage
  11. Logging
  12. Params
  13. Serializable
  14. Serializable
  15. Identifiable
  16. AnyRef
  17. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new PerClassModelLearner(nested: SummarizableEstimator[N], uid: String)

    nested

    Estimator for nested models.

Abstract Value Members

  1. abstract def copy(extra: ParamMap): SummarizableEstimator[M]

    Definition Classes
    SummarizableEstimator → Estimator → PipelineStage → Params
  2. abstract def mergeModels(sqlContext: SQLContext, models: Seq[(String, N)]): M

    Given models trained for each fork create a combined model.

    Given models trained for each fork create a combined model. This model is the result of the estimator.

    Attributes
    protected
    Definition Classes
    ForkedEstimator

Concrete Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def $[T](param: Param[T]): T

    Attributes
    protected
    Definition Classes
    Params
  5. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  6. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  7. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  8. final val cacheForks: Param[Boolean]

    Definition Classes
    ForkedEstimator
  9. final val classesColumn: Param[String]

    Definition Classes
    HasClassesCol
  10. final val classesMap: JacksonParam[Map[String, String]]

  11. final val classesToIgnore: JacksonParam[Set[String]]

  12. final val classesWeights: JacksonParam[Map[String, Double]]

    Definition Classes
    HasClassesWeights
  13. final def clear(param: Param[_]): PerClassModelLearner.this.type

    Definition Classes
    Params
  14. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  15. def copyValues[T <: Params](to: T, extra: ParamMap): T

    Attributes
    protected
    Definition Classes
    Params
  16. def createForks(dataset: DataFrame): Seq[(String, DataFrame)]

    Override this method and create forks to train from the data.

    Override this method and create forks to train from the data.

    Definition Classes
    PerClassModelLearnerForkedEstimator
  17. final def defaultCopy[T <: Params](extra: ParamMap): T

    Attributes
    protected
    Definition Classes
    Params
  18. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  19. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  20. def explainParam(param: Param[_]): String

    Definition Classes
    Params
  21. def explainParams(): String

    Definition Classes
    Params
  22. final def extractParamMap(): ParamMap

    Definition Classes
    Params
  23. final def extractParamMap(extra: ParamMap): ParamMap

    Definition Classes
    Params
  24. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  25. def fit(dataset: DataFrame): M

    Definition Classes
    ForkedEstimator → Estimator
  26. def fit(dataset: DataFrame, paramMaps: Array[ParamMap]): Seq[M]

    Definition Classes
    Estimator
  27. def fit(dataset: DataFrame, paramMap: ParamMap): M

    Definition Classes
    Estimator
  28. def fit(dataset: DataFrame, firstParamPair: ParamPair[_], otherParamPairs: ParamPair[_]*): M

    Definition Classes
    Estimator
    Annotations
    @varargs()
  29. def fitFork(estimator: SummarizableEstimator[N], wholeData: DataFrame, partialData: (String, DataFrame)): (String, N)

    Definition Classes
    ForkedEstimator
  30. final def get[T](param: Param[T]): Option[T]

    Definition Classes
    Params
  31. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  32. def getClassesWeights: Map[String, Double]

    Definition Classes
    HasClassesWeights
  33. final def getDefault[T](param: Param[T]): Option[T]

    Definition Classes
    Params
  34. final def getLabelCol: String

    Definition Classes
    HasLabelCol
  35. final def getOrDefault[T](param: Param[T]): T

    Definition Classes
    Params
  36. def getParam(paramName: String): Param[Any]

    Definition Classes
    Params
  37. final def getPredictionCol: String

    Definition Classes
    HasPredictionCol
  38. final def hasDefault[T](param: Param[T]): Boolean

    Definition Classes
    Params
  39. def hasParam(paramName: String): Boolean

    Definition Classes
    Params
  40. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  41. final def isDefined(param: Param[_]): Boolean

    Definition Classes
    Params
  42. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  43. final def isSet(param: Param[_]): Boolean

    Definition Classes
    Params
  44. def isTraceEnabled(): Boolean

    Attributes
    protected
    Definition Classes
    Logging
  45. final val labelCol: Param[String]

    Definition Classes
    HasLabelCol
  46. def log: Logger

    Attributes
    protected
    Definition Classes
    Logging
  47. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging
  48. def logDebug(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging
  49. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging
  50. def logError(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging
  51. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging
  52. def logInfo(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging
  53. def logName: String

    Attributes
    protected
    Definition Classes
    Logging
  54. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging
  55. def logTrace(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging
  56. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging
  57. def logWarning(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging
  58. def mayBePropagateKey(data: DataFrame, key: Any): DataFrame

    Attributes
    protected
    Definition Classes
    ForkedModelParams
  59. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  60. final def notify(): Unit

    Definition Classes
    AnyRef
  61. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  62. lazy val params: Array[Param[_]]

    Definition Classes
    Params
  63. final val pathForTempModels: Param[String]

    Definition Classes
    ForkedEstimator
  64. final val predictionCol: Param[String]

    Definition Classes
    HasPredictionCol
  65. final val propagatedKeyColumn: Param[String]

    Definition Classes
    ForkedModelParams
  66. final def set(paramPair: ParamPair[_]): PerClassModelLearner.this.type

    Attributes
    protected
    Definition Classes
    Params
  67. final def set(param: String, value: Any): PerClassModelLearner.this.type

    Attributes
    protected
    Definition Classes
    Params
  68. final def set[T](param: Param[T], value: T): PerClassModelLearner.this.type

    Definition Classes
    Params
  69. def setCacheForks(value: Boolean): PerClassModelLearner.this.type

    Definition Classes
    ForkedEstimator
  70. def setClassesColumn(value: String): PerClassModelLearner.this.type

    Definition Classes
    HasClassesCol
  71. def setClassesMap(values: (String, String)*): PerClassModelLearner.this.type

  72. def setClassesToIgnore(values: String*): PerClassModelLearner.this.type

  73. def setClassesWeights(weights: (String, Double)*): PerClassModelLearner.this.type

    Definition Classes
    HasClassesWeights
  74. final def setDefault(paramPairs: ParamPair[_]*): PerClassModelLearner.this.type

    Attributes
    protected
    Definition Classes
    Params
  75. final def setDefault[T](param: Param[T], value: T): PerClassModelLearner.this.type

    Attributes
    protected
    Definition Classes
    Params
  76. def setPathForTempModels(value: String): PerClassModelLearner.this.type

    Definition Classes
    ForkedEstimator
  77. def setPredictionCol(value: String): PerClassModelLearner.this.type

  78. def setPropagatedKeyColumn(value: String): PerClassModelLearner.this.type

    Definition Classes
    ForkedModelParams
  79. def setTrainParallel(value: Boolean): PerClassModelLearner.this.type

    Definition Classes
    ForkedEstimator
  80. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  81. def toString(): String

    Definition Classes
    Identifiable → AnyRef → Any
  82. final val trainParallel: Param[Boolean]

    Definition Classes
    ForkedEstimator
  83. def transformSchema(schema: StructType): StructType

    Definition Classes
    ForkedEstimator → PipelineStage
    Annotations
    @DeveloperApi()
  84. def transformSchema(schema: StructType, logging: Boolean): StructType

    Attributes
    protected
    Definition Classes
    PipelineStage
    Annotations
    @DeveloperApi()
  85. val uid: String

    Definition Classes
    PerClassModelLearnerForkedEstimator → Identifiable
  86. def validateParams(): Unit

    Definition Classes
    Params
  87. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  88. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  89. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from HasPredictionCol

Inherited from HasLabelCol

Inherited from HasClassesWeights

Inherited from HasClassesCol

Inherited from ForkedEstimator[N, String, M]

Inherited from ForkedModelParams

Inherited from SummarizableEstimator[M]

Inherited from Estimator[M]

Inherited from PipelineStage

Inherited from Logging

Inherited from Params

Inherited from Serializable

Inherited from Serializable

Inherited from Identifiable

Inherited from AnyRef

Inherited from Any

Ungrouped