AdamW

lamp.nn.AdamW
See theAdamW companion object
case class AdamW(parameters: Seq[(STen, PTag)], weightDecay: OptimizerHyperparameter, learningRate: OptimizerHyperparameter, beta1: OptimizerHyperparameter, beta2: OptimizerHyperparameter, eps: Double, clip0: Option[Double], debias: Boolean, mixedPrecision: Boolean) extends Optimizer

Attributes

See also
Companion
object
Graph
Supertypes
trait Serializable
trait Product
trait Equals
trait Optimizer
class Object
trait Matchable
class Any
Show all

Members list

Value members

Concrete methods

def downCast(t: STen, target: STen)(implicit scope: Scope): STen
def load(tensors: Seq[STen]): Unit
def release(): Unit
def state: Seq[STen]
def step(gradients: Seq[Option[STen]], scheduleFactor: Double): Unit
def upCast(t: STen)(implicit scope: Scope): STen

Inherited methods

def productElementNames: Iterator[String]

Attributes

Inherited from:
Product
def productIterator: Iterator[Any]

Attributes

Inherited from:
Product

Concrete fields

val clip: Option[STen]
val mt: List[STen]
val scope0: Scope
var stepCount: Long
val stepCountSTen: STen
val vt: List[STen]
val workingCopy: List[Option[STen]]