Shampoo

lamp.nn.Shampoo
See theShampoo companion object
case class Shampoo(parameters: Seq[(STen, PTag)], learningRate: OptimizerHyperparameter, clip0: Option[Double], eps: Double, diagonalThreshold: Int, updatePreconditionerEveryNIterations: Int, momentum: OptimizerHyperparameter) extends Optimizer

Attributes

See also
Companion
object
Graph
Supertypes
trait Serializable
trait Product
trait Equals
trait Optimizer
class Object
trait Matchable
class Any
Show all

Members list

Value members

Concrete methods

def load(tensors: Seq[STen]): Unit
def release(): Unit
def state: Seq[STen]
def step(gradients: Seq[Option[STen]], scheduleFactor: Double): Unit

Inherited methods

def productElementNames: Iterator[String]

Attributes

Inherited from:
Product
def productIterator: Iterator[Any]

Attributes

Inherited from:
Product

Concrete fields

val clip: Option[STen]
val lastGradient: List[STen]
val lt: List[(STen, STen)]
val rt: List[(STen, STen)]
val scope: Scope
var stepCount: Long
val stepCountSTen: STen