Package

com.johnsnowlabs

nlp

Permalink

package nlp

Visibility
  1. Public
  2. All

Type Members

  1. case class Annotation(annotatorType: String, begin: Int, end: Int, result: String, metadata: Map[String, String], embeddings: Array[Float] = Array.emptyFloatArray) extends Product with Serializable

    Permalink

    represents annotator's output parts and their details

    represents annotator's output parts and their details

    annotatorType

    the type of annotation

    begin

    the index of the first character under this annotation

    end

    the index after the last character under this annotation

    metadata

    associated metadata for this annotation

  2. abstract class AnnotatorApproach[M <: Model[M]] extends Estimator[M] with HasInputAnnotationCols with HasOutputAnnotationCol with HasOutputAnnotatorType with DefaultParamsWritable with CanBeLazy

    Permalink

    This class should grow once we start training on datasets and share params For now it stands as a dummy placeholder for future reference

  3. abstract class AnnotatorModel[M <: Model[M]] extends Model[M] with RawAnnotator[M] with CanBeLazy

    Permalink

    This trait implements logic that applies nlp using Spark ML Pipeline transformers Should strongly change once UsedDefinedTypes are allowed https://issues.apache.org/jira/browse/SPARK-7768

  4. trait CanBeLazy extends AnyRef

    Permalink
  5. class Chunk2Doc extends AnnotatorModel[Chunk2Doc] with HasSimpleAnnotate[Chunk2Doc]

    Permalink
  6. class Doc2Chunk extends Model[Doc2Chunk] with RawAnnotator[Doc2Chunk]

    Permalink

    Created by saif on 06/07/17.

  7. class DocumentAssembler extends Transformer with DefaultParamsWritable with HasOutputAnnotatorType with HasOutputAnnotationCol

    Permalink
  8. class EmbeddingsFinisher extends Transformer with DefaultParamsWritable

    Permalink
  9. class FeaturesReader[T <: HasFeatures] extends MLReader[T]

    Permalink
  10. class FeaturesWriter[T] extends MLWriter with HasFeatures

    Permalink
  11. class Finisher extends Transformer with DefaultParamsWritable

    Permalink
  12. trait HasBatchedAnnotate[M <: Model[M]] extends AnyRef

    Permalink
  13. trait HasCaseSensitiveProperties extends ParamsAndFeaturesWritable

    Permalink
  14. trait HasFeatures extends AnyRef

    Permalink
  15. trait HasInputAnnotationCols extends Params

    Permalink
  16. trait HasOutputAnnotationCol extends Params

    Permalink
  17. trait HasOutputAnnotatorType extends AnyRef

    Permalink
  18. trait HasPretrained[M <: PipelineStage] extends AnyRef

    Permalink
  19. trait HasRecursiveFit[M <: Model[M]] extends AnyRef

    Permalink

    AnnotatorApproach'es may extend this trait in order to allow RecursivePipelines to include intermediate steps trained PipelineModel's

  20. trait HasRecursiveTransform[M <: Model[M]] extends AnyRef

    Permalink
  21. trait HasSimpleAnnotate[M <: Model[M]] extends AnyRef

    Permalink
  22. case class JavaAnnotation(annotatorType: String, begin: Int, end: Int, result: String, metadata: Map[String, String], embeddings: Array[Float] = Array.emptyFloatArray) extends Product with Serializable

    Permalink
  23. class LightPipeline extends AnyRef

    Permalink
  24. trait ParamsAndFeaturesReadable[T <: HasFeatures] extends DefaultParamsReadable[T]

    Permalink
  25. trait ParamsAndFeaturesWritable extends DefaultParamsWritable with Params with HasFeatures

    Permalink
  26. trait RawAnnotator[M <: Model[M]] extends Model[M] with ParamsAndFeaturesWritable with HasOutputAnnotatorType with HasInputAnnotationCols with HasOutputAnnotationCol

    Permalink

    Created by jose on 25/01/18.

  27. class RecursivePipeline extends Pipeline

    Permalink
  28. class RecursivePipelineModel extends Model[RecursivePipelineModel] with MLWritable with Logging

    Permalink
  29. class TokenAssembler extends AnnotatorModel[TokenAssembler] with HasSimpleAnnotate[TokenAssembler]

    Permalink

Value Members

  1. object Annotation extends Serializable

    Permalink
  2. object AnnotatorType

    Permalink
  3. object Chunk2Doc extends DefaultParamsReadable[Chunk2Doc] with Serializable

    Permalink
  4. object Doc2Chunk extends DefaultParamsReadable[Doc2Chunk] with Serializable

    Permalink
  5. object DocumentAssembler extends DefaultParamsReadable[DocumentAssembler] with Serializable

    Permalink
  6. object EmbeddingsFinisher extends DefaultParamsReadable[EmbeddingsFinisher] with Serializable

    Permalink
  7. object Finisher extends DefaultParamsReadable[Finisher] with Serializable

    Permalink
  8. object SparkNLP

    Permalink
  9. object TokenAssembler extends DefaultParamsReadable[TokenAssembler] with Serializable

    Permalink
  10. package annotators

    Permalink
  11. package embeddings

    Permalink
  12. object functions

    Permalink
  13. package pretrained

    Permalink
  14. package recursive

    Permalink
  15. package serialization

    Permalink
  16. package training

    Permalink
  17. package util

    Permalink

Ungrouped