org.allenai.nlpstack.parse.poly

eval

package eval

Visibility
  1. Public
  2. All

Type Members

  1. case class CposAccuracy(verbose: Boolean = false) extends ParseStatistic with Product with Serializable

    CposAccuracy stores the statistics necessary to compute coarse-part-of-speech tagging accuracy, which is the percentage of tokens assigned the correct CPOS by the parser.

    CposAccuracy stores the statistics necessary to compute coarse-part-of-speech tagging accuracy, which is the percentage of tokens assigned the correct CPOS by the parser.

    verbose

    if true, reporting gives more detailed error analysis of the tagging mistakes

  2. trait ParseScore extends (PolytreeParse) ⇒ Double

    A ParseScore maps a candidate parse to a score.

  3. abstract class ParseStatistic extends AnyRef

    A ParseStatistic accrues a particular statistic over (candidate parse, gold parse) pairs.

    A ParseStatistic accrues a particular statistic over (candidate parse, gold parse) pairs. Every time .notify() is called, the statistic is updated.

  4. case class PathAccuracy(ignorePunctuation: Boolean, ignorePathLabels: Boolean) extends ParseStatistic with Product with Serializable

  5. case class PathAccuracyScore(goldParseSource: PolytreeParseSource, ignorePunctuation: Boolean, ignorePathLabels: Boolean) extends ParseScore with Product with Serializable

    The PathAccuracyScore computes the percentage of a candidate parse's tokens that have a completely correct breadcrumb path (i.e.

    The PathAccuracyScore computes the percentage of a candidate parse's tokens that have a completely correct breadcrumb path (i.e. if you follow a token's breadcrumbs to the nexus in both the candidate and the gold parse, you encounter the same set of tokens in the same order).

Value Members

  1. object Evaluate

  2. object ParseEvaluator

  3. object UnlabeledBreadcrumbAccuracy extends ParseStatistic with Product with Serializable

    UnlabeledBreadcrumbAccuracy stores the statistics necessary to compute Unlabeled Attachment Score (UAS), which is the percentage of correct breadcrumbs over a set of candidate parses.

Ungrouped