Corpus Quality Assurance

Corpus: ECHR
Key set: LegalTimeML
Response set: ANNOTADOR
Types: [TIMEX3]
Features: [value]

 

Annotation Match Only A Only B Overlap Prec.B/A Rec.B/A F1.0-s. Prec.B/A Rec.B/A F1.0-l.
TIMEX3 91 11 23 4 0.7712 0.8585 0.8125 0.8051 0.8962 0.8482
Macro summary 0.7712 0.8585 0.8125 0.8051 0.8962 0.8482
Micro summary 91 11 23 4 0.7712 0.8585 0.8125 0.8051 0.8962 0.8482

 

Document Match Only A Only B Overlap Prec.B/A Rec.B/A F1.0-s. Prec.B/A Rec.B/A F1.0-l.
ArasTurkey.xml_cleanx 12 1 6 2 0.6000 0.8000 0.6857 0.7000 0.9333 0.8000
AvzhiyanRussia.xml_cleanx 7 0 0 0 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000
BaydinRussia.xml_cleanx 9 0 4 0 0.6923 1.0000 0.8182 0.6923 1.0000 0.8182
BelyaevUkraine.xml_cleanx 6 1 5 0 0.5455 0.8571 0.6667 0.5455 0.8571 0.6667
BozhkoUkraine.xml_cleanx 7 0 0 1 0.8750 0.8750 0.8750 1.0000 1.0000 1.0000
ButuzovRussia.xml_cleanx 11 2 2 0 0.8462 0.8462 0.8462 0.8462 0.8462 0.8462
ChumakRussia.xml_cleanx 8 1 1 0 0.8889 0.8889 0.8889 0.8889 0.8889 0.8889
KashchayevRussia.xml_cleanx 7 0 0 0 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000
KoshelevRussia.xml_cleanx 17 6 5 1 0.7391 0.7083 0.7234 0.7826 0.7500 0.7660
LutsenkoUkraine.xml_cleanx 7 0 0 0 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000
Macro summary 0.8187 0.8975 0.8504 0.8455 0.9275 0.8786
Micro summary 91 11 23 4 0.7712 0.8585 0.8125 0.8051 0.8962 0.8482

 

Document Agreed Total