breeze.optimize.proximal

QuadraticMinimizer

class QuadraticMinimizer extends SerializableLogging

Proximal operators and ADMM based Primal-Dual QP Solver

Reference: http://www.stanford.edu/~boyd/papers/admm/quadprog/quadprog.html

It solves problem that has the following structure

1/2 x'Hx + f'x + g(x) s.t Aeqx = b

g(x) represents the following constraints which covers ALS based matrix factorization use-cases

1. x >= 0 2. lb <= x <= ub 3. L1(x) 4. L2(x) 5. Generic regularization on x

Linear Supertypes
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. QuadraticMinimizer
  2. SerializableLogging
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new QuadraticMinimizer(nGram: Int, proximal: Proximal = null, Aeq: DenseMatrix[Double] = null, beq: DenseVector[Double] = null, maxIters: Int = -1, abstol: Double = 1.0E-6, reltol: Double = 1.0E-4, alpha: Double = 1.0)

    nGram

    rank of dense gram matrix

    proximal

    proximal operator to be used

    Aeq

    rhs matrix for equality constraints

    beq

    lhs constants for equality constraints

    abstol

    ADMM absolute tolerance

    reltol

    ADMM relative tolerance

    alpha

    over-relaxation parameter default 1.0 1.5 - 1.8 can improve convergence

Type Members

  1. type BDM = DenseMatrix[Double]

  2. type BDV = DenseVector[Double]

  3. case class State extends Product with Serializable

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. val admmIters: Int

  7. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  8. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  11. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. val full: Int

  13. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  14. def getProximal: Proximal

  15. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  16. def initialize: State

    Public API to get an initialState for solver hot start such that subsequent calls can reuse state memmory

    Public API to get an initialState for solver hot start such that subsequent calls can reuse state memmory

    returns

    the state for the optimizer

  17. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  18. val linearEquality: Int

  19. def logger: LazyLogger

    Attributes
    protected
    Definition Classes
    SerializableLogging
  20. def minimize(q: DenseVector[Double]): DenseVector[Double]

  21. def minimize(H: DenseMatrix[Double], q: DenseVector[Double]): DenseVector[Double]

  22. def minimize(upper: Array[Double], q: DenseVector[Double], initialState: State): DenseVector[Double]

    minimize API for cases where upper triangular gram matrix is provided by user as primitive array.

    minimize API for cases where upper triangular gram matrix is provided by user as primitive array. If a initialState is not provided by default it constructs it through initialize

    upper

    upper triangular gram matrix of size rank x (rank + 1)/2

    q

    linear term for quadratic optimization

    initialState

    provide an optional initialState for memory optimization

    returns

    converged solution

  23. def minimize(H: DenseMatrix[Double], q: DenseVector[Double], initialState: State): DenseVector[Double]

    minimize API for cases where gram matrix is provided by the user.

    minimize API for cases where gram matrix is provided by the user. If a initialState is not provided by default it constructs it through initialize

    H

    symmetric gram matrix of size rank x rank

    q

    linear term for quadratic optimization

    initialState

    provide an optional initialState for memory optimization

    returns

    converged solution

  24. def minimize(q: DenseVector[Double], initialState: State): DenseVector[Double]

    minimize API for cases where gram matrix is updated through updateGram API.

    minimize API for cases where gram matrix is updated through updateGram API. If a initialState is not provided by default it constructs it through initialize

    q

    linear term for quadratic optimization

    initialState

    provide an optional initialState for memory optimization

    returns

    converged solution

  25. def minimizeAndReturnState(q: DenseVector[Double]): State

  26. def minimizeAndReturnState(H: DenseMatrix[Double], q: DenseVector[Double]): State

  27. def minimizeAndReturnState(upper: Array[Double], q: DenseVector[Double], initialState: State): State

    minimizeAndReturnState API that takes upper triangular entries of the gram matrix specified through primitive array for performance reason and the linear term for quadratic minimization

    minimizeAndReturnState API that takes upper triangular entries of the gram matrix specified through primitive array for performance reason and the linear term for quadratic minimization

    upper

    upper triangular gram matrix specified as primitive array

    q

    linear term

    initialState

    provide a initialState using initialState API for memory optimization

    returns

    converged state from QuadraticMinimizer

  28. def minimizeAndReturnState(H: DenseMatrix[Double], q: DenseVector[Double], initialState: State): State

    minimizeAndReturnState API that takes a symmetric full gram matrix and the linear term for quadratic minimization

    minimizeAndReturnState API that takes a symmetric full gram matrix and the linear term for quadratic minimization

    H

    gram matrix, symmetric of size rank x rank

    q

    linear term

    initialState

    provide a initialState using initialState API for memory optimization

    returns

    converged state from QuadraticMinimizer

  29. def minimizeAndReturnState(q: DenseVector[Double], initialState: State): State

    minimizeAndReturnState API gives an advanced control for users who would like to use QuadraticMinimizer in 2 steps, update the gram matrix first using updateGram API and followed by doing the solve by providing a user defined initialState.

    minimizeAndReturnState API gives an advanced control for users who would like to use QuadraticMinimizer in 2 steps, update the gram matrix first using updateGram API and followed by doing the solve by providing a user defined initialState. rho is automatically calculated by QuadraticMinimizer from problem structure

    q

    linear term for the quadratic optimization

    initialState

    provide a initialState using initialState API

    returns

    converged state from QuadraticMinimizer

  30. def minimizeAndReturnState(q: DenseVector[Double], rho: Double, initialState: State, resetState: Boolean = true): State

    minimizeAndReturnState API gives an advanced control for users who would like to use QuadraticMinimizer in 2 steps, update the gram matrix first using updateGram API and followed by doing the solve by providing a user defined initialState.

    minimizeAndReturnState API gives an advanced control for users who would like to use QuadraticMinimizer in 2 steps, update the gram matrix first using updateGram API and followed by doing the solve by providing a user defined initialState. It also exposes rho control to users who would like to experiment with rho parameters of the admm algorithm. Use user-defined rho only if you understand the proximal algorithm well

    q

    linear term for the quadratic optimization

    rho

    rho parameter for ADMM algorithm

    initialState

    provide a initialState using initialState API

    resetState

    use true if you want to hot start based on the provided state

    returns

    converged state from ADMM algorithm

  31. val n: Int

  32. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  33. final def notify(): Unit

    Definition Classes
    AnyRef
  34. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  35. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  36. def toString(): String

    Definition Classes
    AnyRef → Any
  37. val transAeq: DenseMatrix[Double]

  38. def updateGram(upper: Array[Double]): Unit

    updateGram API allows user to seed QuadraticMinimizer with upper triangular gram matrix (memory optimization by 50%) specified through primitive arrays.

    updateGram API allows user to seed QuadraticMinimizer with upper triangular gram matrix (memory optimization by 50%) specified through primitive arrays. It is exposed for advanced users like Spark ALS where ALS constructs normal equations as primitive arrays

    upper

    upper triangular gram matrix specified in primitive array

  39. def updateGram(H: DenseMatrix[Double]): Unit

    updateGram allows the user to seed QuadraticMinimizer with symmetric gram matrix most useful for cases where the gram matrix does not change but the linear term changes for multiple solves.

    updateGram allows the user to seed QuadraticMinimizer with symmetric gram matrix most useful for cases where the gram matrix does not change but the linear term changes for multiple solves. It should be called iteratively from Normal Equations constructed by the user

    H

    rank * rank size full gram matrix

  40. val upperSize: Int

  41. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  42. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  43. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from SerializableLogging

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped