Calculate accuracy significance for labels predicted by a system over labels predicted by a baseline, compared to actual labels, using the bootstrap.
Calculate accuracy significance for labels predicted by a system over labels predicted by a baseline, compared to actual labels, using the bootstrap.
The label type
The labels predicted by the treatment system
The labels predicted by the baseline (control) system
The actual labels
Number of samples to use in bootstrap
The p-value significance of the accuracy statistic
Calculate significance of the given evaluation statistic for labels predicted by a system over labels predicted by a baseline, compared to actual labels, using the bootstrap.
Calculate significance of the given evaluation statistic for labels predicted by a system over labels predicted by a baseline, compared to actual labels, using the bootstrap.
The label type
A function of EvaluationStatistics, such as accuracy or microF1
The labels predicted by the treatment system
The labels predicted by the baseline (control) system
The actual labels
Number of samples to use in bootstrap
The p-value of the statistic
Created by dfried on 5/22/14