core

Type Members

1. class ChunkedToken extends PostaggedToken

   A representation of a chunked token.

2. abstract class Chunker extends AnyRef

   A Chunker takes postagged text and adds a chunk tag, specifying whether a noun or verb phrase is starting or continuing.

3. trait ConstituencyParser extends AnyRef

   A constituency parser turns a sentence into a constituency tree, a structure that is somewhat like chunking but hierarchical.

4. trait DependencyParser extends AnyRef

   A trait for a tool that produces a dependency graph, such as the Stanford dependency parser.

5. trait Format[F, T] extends Writer[F, T] with Reader[T, F]

6. case class Lemmatized[+T <: Token](token: T, lemma: String) extends Product with Serializable

7. abstract class ParseTree extends Iterable[ParseTree]

   A representation of the constituency parse.

8. class ParseTreePhrase extends ParseTree

9. class ParseTreePostag extends ParseTree

10. class ParseTreeToken extends ParseTree

11. trait PostaggedStemmer extends AnyRef

12. class PostaggedToken extends Token

    A representation for a part-of-speech tagged token.

13. abstract class Postagger extends AnyRef

    A POS tagger takes tokenized input and associates a part of speech tag with each token.

14. trait Reader[F, T] extends AnyRef

15. case class Segment(text: String, offset: Int) extends Product with Serializable

16. abstract class Segmenter extends AnyRef

    A sentencer breaks text into sentences.

17. abstract class Stemmer extends AnyRef

    A stemmer takes a string token and produces a normalized form.

18. class Token extends AnyRef

    The most simple representation of a token.

19. trait Tokenizer extends AnyRef

    A tokenizer takes a sentence string as input and separates words (tokens) along word (token) boundaries.

20. trait Writer[F, T] extends AnyRef