Class/Object

org.apache.spark.ml.odkl

MatrixLBFGS

Related Docs: object MatrixLBFGS | package odkl

Permalink

class MatrixLBFGS extends Estimator[LinearCombinationModel[LogisticRegressionModel]] with SummarizableEstimator[LinearCombinationModel[LogisticRegressionModel]] with PredictorParams with HasTol with HasMaxIter with HasRegParam with HasRegularizeLast with HasBatchSize with HasNetlibBlas

Created by dmitriybugaichenko on 24.03.16.

Implementation for multi-class logistic regression training. In contrast to traditional notion of multi-class logistic regression this trainer produces one regression per each class. Internally treats all classes simultaneously using matrix-matrix multplication. Allows for L1-regularization (switches LBFGS to OWL-QN for that). Regularization strength is defined in terms of fraction of maximal feasible regularization (deduced using http://jmlr.org/papers/volume8/koh07a/koh07a.pdf).

Linear Supertypes
HasNetlibBlas, HasBatchSize, HasRegularizeLast, HasRegParam, HasMaxIter, HasTol, PredictorParams, HasPredictionCol, HasFeaturesCol, HasLabelCol, SummarizableEstimator[LinearCombinationModel[LogisticRegressionModel]], Estimator[LinearCombinationModel[LogisticRegressionModel]], PipelineStage, Logging, Params, Serializable, Serializable, Identifiable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. MatrixLBFGS
  2. HasNetlibBlas
  3. HasBatchSize
  4. HasRegularizeLast
  5. HasRegParam
  6. HasMaxIter
  7. HasTol
  8. PredictorParams
  9. HasPredictionCol
  10. HasFeaturesCol
  11. HasLabelCol
  12. SummarizableEstimator
  13. Estimator
  14. PipelineStage
  15. Logging
  16. Params
  17. Serializable
  18. Serializable
  19. Identifiable
  20. AnyRef
  21. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new MatrixLBFGS()

    Permalink

  2. new MatrixLBFGS(uid: String)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def $[T](param: Param[T]): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  4. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  6. def axpy(a: Double, x: Vector, y: Array[Double]): Unit

    Permalink
    Definition Classes
    HasNetlibBlas

  7. def axpy(a: Double, x: Array[Double], y: Array[Double]): Unit

    Permalink
    Definition Classes
    HasNetlibBlas

  8. val batchSize: Param[Int]

    Permalink
    Definition Classes
    HasBatchSize

  9. def blas: BLAS

    Permalink
    Definition Classes
    HasNetlibBlas

  10. final def clear(param: Param[_]): MatrixLBFGS.this.type

    Permalink
    Definition Classes
    Params

  11. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  12. def copy(extra: ParamMap): MatrixLBFGS

    Permalink
    Definition Classes
    MatrixLBFGS → SummarizableEstimator → Estimator → PipelineStage → Params

  13. def copy(x: Array[Double], y: Array[Double]): Unit

    Permalink
    Definition Classes
    HasNetlibBlas

  14. def copyValues[T <: Params](to: T, extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  15. final def defaultCopy[T <: Params](extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  16. def dscal(a: Double, data: Array[Double]): Unit

    Permalink
    Definition Classes
    HasNetlibBlas

  17. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  18. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  19. def explainParam(param: Param[_]): String

    Permalink
    Definition Classes
    Params

  20. def explainParams(): String

    Permalink
    Definition Classes
    Params

  21. final def extractParamMap(): ParamMap

    Permalink
    Definition Classes
    Params

  22. final def extractParamMap(extra: ParamMap): ParamMap

    Permalink
    Definition Classes
    Params

  23. def f2jBLAS: BLAS

    Permalink
    Definition Classes
    HasNetlibBlas

  24. final val featuresCol: Param[String]

    Permalink
    Definition Classes
    HasFeaturesCol

  25. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  26. def fit(dataset: Dataset[_]): LinearCombinationModel[LogisticRegressionModel]

    Permalink
    Definition Classes
    MatrixLBFGS → Estimator

  27. def fit(dataset: Dataset[_], paramMaps: Array[ParamMap]): Seq[LinearCombinationModel[LogisticRegressionModel]]

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )

  28. def fit(dataset: Dataset[_], paramMap: ParamMap): LinearCombinationModel[LogisticRegressionModel]

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )

  29. def fit(dataset: Dataset[_], firstParamPair: ParamPair[_], otherParamPairs: ParamPair[_]*): LinearCombinationModel[LogisticRegressionModel]

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" ) @varargs()

  30. final def get[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params

  31. def getBatchSize: Int

    Permalink
    Definition Classes
    HasBatchSize

  32. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  33. final def getDefault[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params

  34. final def getFeaturesCol: String

    Permalink
    Definition Classes
    HasFeaturesCol

  35. final def getLabelCol: String

    Permalink
    Definition Classes
    HasLabelCol

  36. final def getMaxIter: Int

    Permalink
    Definition Classes
    HasMaxIter

  37. final def getOrDefault[T](param: Param[T]): T

    Permalink
    Definition Classes
    Params

  38. def getParam(paramName: String): Param[Any]

    Permalink
    Definition Classes
    Params

  39. final def getPredictionCol: String

    Permalink
    Definition Classes
    HasPredictionCol

  40. final def getRegParam: Double

    Permalink
    Definition Classes
    HasRegParam

  41. def getRegularizeLast: Boolean

    Permalink
    Definition Classes
    HasRegularizeLast

  42. final def getTol: Double

    Permalink
    Definition Classes
    HasTol

  43. final def hasDefault[T](param: Param[T]): Boolean

    Permalink
    Definition Classes
    Params

  44. def hasParam(paramName: String): Boolean

    Permalink
    Definition Classes
    Params

  45. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  46. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  47. final def isDefined(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params

  48. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  49. final def isSet(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params

  50. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  51. final val labelCol: Param[String]

    Permalink
    Definition Classes
    HasLabelCol

  52. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  53. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  54. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  55. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  56. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  57. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  58. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  59. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  60. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  61. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  62. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  63. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  64. final val maxIter: IntParam

    Permalink
    Definition Classes
    HasMaxIter

  65. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  66. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  67. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  68. val numCorrections: Param[Int]

    Permalink

  69. lazy val params: Array[Param[_]]

    Permalink
    Definition Classes
    Params

  70. val predictVector: Param[Boolean]

    Permalink

  71. final val predictionCol: Param[String]

    Permalink
    Definition Classes
    HasPredictionCol

  72. final val regParam: DoubleParam

    Permalink
    Definition Classes
    HasRegParam

  73. val regularizeLast: BooleanParam

    Permalink
    Definition Classes
    HasRegularizeLast

  74. final def set(paramPair: ParamPair[_]): MatrixLBFGS.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  75. final def set(param: String, value: Any): MatrixLBFGS.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  76. final def set[T](param: Param[T], value: T): MatrixLBFGS.this.type

    Permalink
    Definition Classes
    Params

  77. def setBatchSize(value: Int): MatrixLBFGS.this.type

    Permalink
    Definition Classes
    HasBatchSize

  78. final def setDefault(paramPairs: ParamPair[_]*): MatrixLBFGS.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  79. final def setDefault[T](param: Param[T], value: T): MatrixLBFGS.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params

  80. def setPredictVector(value: Boolean): MatrixLBFGS.this.type

    Permalink

  81. def setRegParam(value: Double): MatrixLBFGS.this.type

    Permalink

  82. def setRegularizeLast(value: Boolean): MatrixLBFGS.this.type

    Permalink
    Definition Classes
    HasRegularizeLast

  83. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  84. def toString(): String

    Permalink
    Definition Classes
    Identifiable → AnyRef → Any

  85. final val tol: DoubleParam

    Permalink
    Definition Classes
    HasTol

  86. def transformSchema(schema: StructType): StructType

    Permalink
    Definition Classes
    MatrixLBFGS → PipelineStage
    Annotations
    @DeveloperApi()

  87. def transformSchema(schema: StructType, logging: Boolean): StructType

    Permalink
    Attributes
    protected
    Definition Classes
    PipelineStage
    Annotations
    @DeveloperApi()

  88. val uid: String

    Permalink
    Definition Classes
    MatrixLBFGS → Identifiable

  89. def validateAndTransformSchema(schema: StructType, fitting: Boolean, featuresDataType: DataType): StructType

    Permalink
    Attributes
    protected
    Definition Classes
    PredictorParams

  90. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  91. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  92. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from HasNetlibBlas

Inherited from HasBatchSize

Inherited from HasRegularizeLast

Inherited from HasRegParam

Inherited from HasMaxIter

Inherited from HasTol

Inherited from PredictorParams

Inherited from HasPredictionCol

Inherited from HasFeaturesCol

Inherited from HasLabelCol

Inherited from SummarizableEstimator[LinearCombinationModel[LogisticRegressionModel]]

Inherited from Estimator[LinearCombinationModel[LogisticRegressionModel]]

Inherited from PipelineStage

Inherited from Logging

Inherited from Params

Inherited from Serializable

Inherited from Serializable

Inherited from Identifiable

Inherited from AnyRef

Inherited from Any

Ungrouped