Commit 0b94ae2e authored by Vít Novotný's avatar Vít Novotný
Browse files

Remove topics B.58 and B.65 from qrel_task2*.tsv

parent 8c8214b2
Pipeline #62603 failed with stage
......@@ -36,7 +36,7 @@ trained using subsets of the `task1` and `task2` tasks.
#### Using the `train` subset to train your supervised system
``` sh
$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.13
$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.14
$ python
>>> from arqmath_eval import get_topics, get_judged_documents, get_ndcg
>>>
......@@ -64,7 +64,7 @@ Here is the documentation of the available evaluation functions:
#### Using the `validation` subset to compare various parameters of your system
``` sh
$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.13
$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.14
$ python
>>> from arqmath_eval import get_topics, get_judged_documents
>>>
......@@ -95,7 +95,7 @@ $ git push # publish your new result and the upd
#### Using the `all` subset to compute the NDCG' score of an ARQMath submission
``` sh
$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.13
$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.14
$ python -m arqmath_eval.evaluate MIRMU-task1-Ensemble-auto-both-A.tsv
0.238
```
......
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
......@@ -5,7 +5,7 @@ from setuptools import setup
setup(
name='arqmath_eval',
version='0.0.13',
version='0.0.14',
description='Evaluation of ARQMath systems',
packages=['arqmath_eval'],
package_dir={'arqmath_eval': 'scripts'},
......
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment