lamp-core/lamp.nn/RAdam

RAdam

case class RAdam(parameters: Seq[(STen, PTag)], weightDecay: OptimizerHyperparameter, learningRate: OptimizerHyperparameter, beta1: OptimizerHyperparameter, beta2: OptimizerHyperparameter, eps: Double, clip: Option[Double]) extends Optimizer

Rectified Adam optimizer algorithm

Companion:
object
trait Serializable
trait Product
trait Equals
trait Optimizer
class Object
trait Matchable
class Any

Value members

Concrete methods

def load(tensors: Seq[STen]): Unit
def release(): Unit
def state: Seq[STen]
def step(gradients: Seq[Option[STen]], scheduleFactor: Double): Unit

Inherited methods

def productElementNames: Iterator[String]
Inherited from:
Product
def productIterator: Iterator[Any]
Inherited from:
Product

Concrete fields

val mt: List[STen]
val scope: Scope
var stepCount: Long
val stepCountSTen: STen
val vt: List[STen]