Commit 0b94ae2e authored by Vít Novotný's avatar Vít Novotný
Browse files

Remove topics B.58 and B.65 from qrel_task2*.tsv

parent 8c8214b2

README.md

+3 −3
Original line number Diff line number Diff line
@@ -36,7 +36,7 @@ trained using subsets of the `task1` and `task2` tasks. 
#### Using the `train` subset to train your supervised system



``` sh

$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.13

$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.14

$ python

>>> from arqmath_eval import get_topics, get_judged_documents, get_ndcg

>>>
@@ -64,7 +64,7 @@ Here is the documentation of the available evaluation functions: 
#### Using the `validation` subset to compare various parameters of your system



``` sh

$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.13

$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.14

$ python

>>> from arqmath_eval import get_topics, get_judged_documents

>>>
@@ -95,7 +95,7 @@ $ git push # publish your new result and the upd 
#### Using the `all` subset to compute the NDCG' score of an ARQMath submission



``` sh

$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.13

$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.14

$ python -m arqmath_eval.evaluate MIRMU-task1-Ensemble-auto-both-A.tsv

0.238

```