lamp.nn.PositionalEmbedding$
Attributes
-
Graph
-
-
Supertypes
-
class Object
trait Matchable
class Any
-
Self type
-
Members list
Linearly decomposed sequence distance encoding
Linearly decomposed sequence distance encoding
Value parameters
-
dimension
-
output dimension
Attributes
-
Returns
-
the first dimension left singular vectors of the row normalized p where p(i,j) = min(maxDist,abs(i-j))
The trigonometric position encoding from https://arxiv.org/abs/1706.03762
Value parameters
-
dimension
-
output dimension of the encoding
Attributes