Commit 0b94ae2e authored by Vít Novotný's avatar Vít Novotný
Browse files

Remove topics B.58 and B.65 from qrel_task2*.tsv

parent 8c8214b2
Loading
Loading
Loading
Loading
Loading
+3 −3
Original line number Original line Diff line number Diff line
@@ -36,7 +36,7 @@ trained using subsets of the `task1` and `task2` tasks.
#### Using the `train` subset to train your supervised system
#### Using the `train` subset to train your supervised system


``` sh
``` sh
$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.13
$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.14
$ python
$ python
>>> from arqmath_eval import get_topics, get_judged_documents, get_ndcg
>>> from arqmath_eval import get_topics, get_judged_documents, get_ndcg
>>>
>>>
@@ -64,7 +64,7 @@ Here is the documentation of the available evaluation functions:
#### Using the `validation` subset to compare various parameters of your system
#### Using the `validation` subset to compare various parameters of your system


``` sh
``` sh
$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.13
$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.14
$ python
$ python
>>> from arqmath_eval import get_topics, get_judged_documents
>>> from arqmath_eval import get_topics, get_judged_documents
>>>
>>>
@@ -95,7 +95,7 @@ $ git push # publish your new result and the upd
#### Using the `all` subset to compute the NDCG' score of an ARQMath submission
#### Using the `all` subset to compute the NDCG' score of an ARQMath submission


``` sh
``` sh
$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.13
$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.14
$ python -m arqmath_eval.evaluate MIRMU-task1-Ensemble-auto-both-A.tsv
$ python -m arqmath_eval.evaluate MIRMU-task1-Ensemble-auto-both-A.tsv
0.238
0.238
```
```
+2621 −3165

File changed.

Preview size limit exceeded, changes collapsed.

+31391 −30367

File changed.

Preview size limit exceeded, changes collapsed.

+3027 −3507

File changed.

Preview size limit exceeded, changes collapsed.

+37921 −37921

File changed.

Preview size limit exceeded, changes collapsed.

Loading