Skip to content
Snippets Groups Projects

Correct error in evaluation instructions

Merged Carlos Ramisch requested to merge carlos.ramisch-master-patch-19506 into master
1 file
+ 2
2
Compare changes
  • Side-by-side
  • Inline
+ 2
2
@@ -41,9 +41,9 @@ The `DiMSUM` shared task provides a script called `dimsum-data/scripts/dimsumeva
@@ -41,9 +41,9 @@ The `DiMSUM` shared task provides a script called `dimsum-data/scripts/dimsumeva
```bash
```bash
eval/dimsum2cupt.py --dimsum-file dimsum-data/dimsum16.test.pred > dimsum-data/dimsum16.test.pred.cupt
eval/dimsum2cupt.py --dimsum-file dimsum-data/dimsum16.test.pred > dimsum-data/dimsum16.test.pred.cupt
# Supersense P/R/F
# Supersense P/R/F
eval/evaluate-ss.py --gold dimsum-data/dimsum16.train.cupt --pred dimsum-data/dimsum16.test.pred.cupt
eval/evaluate-ss.py --gold dimsum-data/dimsum16.test.cupt --pred dimsum-data/dimsum16.test.pred.cupt
# MWE P/R/F for exact match (MWE-based) and fuzzy match (Token-based) + some additional stats
# MWE P/R/F for exact match (MWE-based) and fuzzy match (Token-based) + some additional stats
eval/evaluate-mwe.py --gold dimsum-data/dimsum16.train.cupt --pred dimsum-data/dimsum16.test.pred.cupt
eval/evaluate-mwe.py --gold dimsum-data/dimsum16.test.cupt --pred dimsum-data/dimsum16.test.pred.cupt
```
```
Loading