Remove topics B.58 and B.65 from qrel_task2*.tsv (0b94ae2e) · Commits · Michal Štefánik / ARQMath-eval

README.md

+3 −3

Original line number	Original line	Diff line number	Diff line
	@@ -36,7 +36,7 @@ trained using subsets of the `task1` and `task2` tasks.
	#### Using the `train` subset to train your supervised system		#### Using the `train` subset to train your supervised system

	``` sh		``` sh
	$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.13		$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.14
	$ python		$ python
	>>> from arqmath_eval import get_topics, get_judged_documents, get_ndcg		>>> from arqmath_eval import get_topics, get_judged_documents, get_ndcg
	>>>		>>>
	@@ -64,7 +64,7 @@ Here is the documentation of the available evaluation functions:
	#### Using the `validation` subset to compare various parameters of your system		#### Using the `validation` subset to compare various parameters of your system

	``` sh		``` sh
	$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.13		$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.14
	$ python		$ python
	>>> from arqmath_eval import get_topics, get_judged_documents		>>> from arqmath_eval import get_topics, get_judged_documents
	>>>		>>>
	@@ -95,7 +95,7 @@ $ git push # publish your new result and the upd
	#### Using the `all` subset to compute the NDCG' score of an ARQMath submission		#### Using the `all` subset to compute the NDCG' score of an ARQMath submission

	``` sh		``` sh
	$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.13		$ pip install --force-reinstall git+https://github.com/MIR-MU/ARQMath-eval@0.0.14
	$ python -m arqmath_eval.evaluate MIRMU-task1-Ensemble-auto-both-A.tsv		$ python -m arqmath_eval.evaluate MIRMU-task1-Ensemble-auto-both-A.tsv
	0.238		0.238
	```		```

scripts/qrel_task1-test.tsv

+2621 −3165

File changed.

Preview size limit exceeded, changes collapsed.

scripts/qrel_task1-train.tsv

+31391 −30367

File changed.

Preview size limit exceeded, changes collapsed.

scripts/qrel_task1-validation.tsv

+3027 −3507

File changed.

Preview size limit exceeded, changes collapsed.

scripts/qrel_task1.tsv

+37921 −37921

File changed.

Preview size limit exceeded, changes collapsed.