lamp-core/lamp.nn/TransformerEncoderBlock

TransformerEncoderBlock

object TransformerEncoderBlock
Companion:
class
trait Product
trait Mirror
class Object
trait Matchable
class Any

Type members

Classlikes

object Bias1 extends LeafTag
object Bias2 extends LeafTag
object Weights1 extends LeafTag
object Weights2 extends LeafTag

Inherited types

type MirroredElemLabels <: Tuple

The names of the product elements

The names of the product elements

Inherited from:
Mirror
type MirroredLabel <: String

The name of the type

The name of the type

Inherited from:
Mirror

Value members

Concrete methods

def apply[S : Sc](in: Int, attentionHiddenPerHeadDim: Int, attentionNumHeads: Int, mlpHiddenDim: Int, out: Int, dropout: Double, padToken: Long, tOpt: STenOptions, linearized: Boolean): TransformerEncoderBlock

Implicits

Implicits