lamp-core
API
Generated with
lamp-core/lamp/lamp.nn/lamp.nn.bert/MaskedLanguageModelModule

MaskedLanguageModelModule

lamp.nn.bert.MaskedLanguageModelModule
See theMaskedLanguageModelModule companion object
case class MaskedLanguageModelModule(mlp: MLP) extends GenericModule[(Variable, STen), Variable]

Masked Language Model Input of (embedding, positions) Embedding of size (batch, num tokens, embedding dim) Positions of size (batch, max num tokens) long tensor indicating which positions to make predictions on Output (batch, len(Positions), vocabulary size)

Attributes

Companion
object
Graph
Supertypes
trait Serializable
trait Product
trait Equals
trait GenericModule[(Variable, STen), Variable]
class Object
trait Matchable
class Any
Show all

Members list

Value members

Concrete methods

def forward[S : Sc](x: (Variable, STen)): Variable

The implementation of the function.

The implementation of the function.

In addition of x it can also use all the `state to compute its value.

Attributes

def state: Seq[(Constant, PTag)]

List of optimizable, or non-optimizable, but stateful parameters

List of optimizable, or non-optimizable, but stateful parameters

Stateful means that the state is carried over the repeated forward calls.

Attributes

Inherited methods

def apply[S : Sc](a: (Variable, STen)): B

Alias of forward

Alias of forward

Attributes

Inherited from:
GenericModule
final def gradients(loss: Variable, zeroGrad: Boolean): Seq[Option[STen]]

Computes the gradient of loss with respect to the parameters.

Computes the gradient of loss with respect to the parameters.

Attributes

Inherited from:
GenericModule
final def learnableParameters: Long

Returns the total number of optimizable parameters.

Returns the total number of optimizable parameters.

Attributes

Inherited from:
GenericModule
final def parameters: Seq[(Constant, PTag)]

Returns the state variables which need gradient computation.

Returns the state variables which need gradient computation.

Attributes

Inherited from:
GenericModule
def productElementNames: Iterator[String]

Attributes

Inherited from:
Product
def productIterator: Iterator[Any]

Attributes

Inherited from:
Product
final def zeroGrad(): Unit

Attributes

Inherited from:
GenericModule
Generated with