Packages

package bert

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. bert
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Type Members

  1. case class BertData(maskedTokens: STen, segments: STen, predictionPositions: STen, maskedLanguageModelTarget: STen, nextSentenceTarget: STen) extends Product with Serializable

Value Members

  1. def makeMaskForMaskedLanguageModel(bertTokens: Array[Int], maximumTokenId: Int, clsToken: Int, sepToken: Int, maskToken: Int, rng: Random): (Array[Int], Array[Int], Array[Int])
  2. def minibatchesFromFull(minibatchSize: Int, dropLast: Boolean, fullData: BertData, rng: Random): BatchStream[BertLossInput, Int]
  3. def pad(v: Array[Int], paddedLength: Int, padElem: Int): Array[Int]
  4. def prepareFullDatasetFromTokenizedParagraphs[S](paragraphs: Vector[Vector[Array[Int]]], maximumTokenId: Int, clsToken: Int, sepToken: Int, padToken: Int, maskToken: Int, maxLength: Int, rng: Random)(implicit arg0: Sc[S]): BertData
  5. def prepareParagraph[S](paragraph: Vector[Array[Int]], maximumTokenId: Int, clsToken: Int, sepToken: Int, padToken: Int, maskToken: Int, maxLength: Int, rng: Random)(implicit arg0: Sc[S]): Vector[(Boolean, STen, STen, STen, STen)]

Inherited from AnyRef

Inherited from Any

Ungrouped