Package

com.johnsnowlabs.nlp

embeddings

Permalink

package embeddings

Visibility
  1. Public
  2. All

Type Members

  1. abstract class AnnotatorWithWordEmbeddings[A <: AnnotatorWithWordEmbeddings[A, M], M <: ModelWithWordEmbeddings[M]] extends AnnotatorApproach[M] with AutoCloseable

    Permalink

    Base class for annotators that uses Word Embeddings.

    Base class for annotators that uses Word Embeddings. This implementation is based on RocksDB so it has a compact RAM usage

    1. User configures Word Embeddings by method 'setWordEmbeddingsSource'. 2. During training Word Embeddings are indexed as RockDB index file. 3. Than this index file is spread across the cluster. 4. Every model 'ModelWithWordEmbeddings' uses local RocksDB as Word Embeddings lookup.

  2. trait EmbeddingsReadable[T <: ModelWithWordEmbeddings[_]] extends ParamsAndFeaturesReadable[T]

    Permalink
  3. abstract class ModelWithWordEmbeddings[M <: ModelWithWordEmbeddings[M]] extends AnnotatorModel[M] with AutoCloseable

    Permalink

    Base class for models that uses Word Embeddings.

    Base class for models that uses Word Embeddings. This implementation is based on RocksDB so it has a compact RAM usage

    Corresponding Approach have to implement AnnotatorWithWordEmbeddings

  4. case class WordEmbeddings(dbFile: String, nDims: Int, cacheSizeMB: Int = 100, lruCacheSize: Int = 100000) extends Closeable with Product with Serializable

    Permalink

Value Members

  1. object WordEmbeddingsClusterHelper

    Permalink
  2. object WordEmbeddingsFormat extends Enumeration

    Permalink
  3. object WordEmbeddingsIndexer

    Permalink

Ungrouped