Commit e7279bfa authored Apr 13, 2020 by Vít Novotný

Add Math StackExchange user votes

parent cc5aeb0e

MANIFEST.in

+4 −0

Original line number	Original line	Diff line number	Diff line
	@@ -6,3 +6,7 @@ scripts/NTCIR12_MathWikiFrm-qrels_agg-train.dat
	scripts/NTCIR12_MathWikiFrm-qrels_agg-test.dat		scripts/NTCIR12_MathWikiFrm-qrels_agg-test.dat
	scripts/qrel.V1.0-train.tsv		scripts/qrel.V1.0-train.tsv
	scripts/qrel.V1.0-test.tsv		scripts/qrel.V1.0-test.tsv
			scripts/votes-qrels-train.V1.0.tsv
			scripts/votes-qrels-train-train.V1.0.tsv
			scripts/votes-qrels-train-validation.V1.0.tsv
			scripts/votes-qrels-test.V1.0.tsv

README.md

+3 −1

Original line number	Original line	Diff line number	Diff line
	@@ -12,6 +12,7 @@ This repository evaluates the performance of your information retrieval system
	on a number of tasks:		on a number of tasks:

	- `task1/` – [ARQMath Task1][arqmath-task1] validation dataset,		- `task1/` – [ARQMath Task1][arqmath-task1] validation dataset,
			- `task1-votes/` – [ARQMath Task1][arqmath-task1] Math StackExchange [user votes][],
	- `ntcir-11-math-2-main/` – [NTCIR-11 Math-2 Task Main Subtask][ntcir-11-math-2], and		- `ntcir-11-math-2-main/` – [NTCIR-11 Math-2 Task Main Subtask][ntcir-11-math-2], and
	- `ntcir-12-mathir-arxiv-main/` – [NTCIR-12 MathIR Task ArXiv Main Subtask][ntcir-12-mathir].		- `ntcir-12-mathir-arxiv-main/` – [NTCIR-12 MathIR Task ArXiv Main Subtask][ntcir-12-mathir].
	- `ntcir-12-mathir-math-wiki-formula/` – [NTCIR-12 MathIR Task MathWikiFormula Subtask][ntcir-12-mathir].		- `ntcir-12-mathir-math-wiki-formula/` – [NTCIR-12 MathIR Task MathWikiFormula Subtask][ntcir-12-mathir].
	@@ -34,3 +35,4 @@ $ git push # publish your new result and the updated lea
	[treceval-format]: https://stackoverflow.com/a/8175382/657401 (How to evaluate a search/retrieval engine using trec_eval?)		[treceval-format]: https://stackoverflow.com/a/8175382/657401 (How to evaluate a search/retrieval engine using trec_eval?)
	[ntcir-11-math-2]: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.686.444&rep=rep1&type=pdf (NTCIR-11 Math-2 Task Overview)		[ntcir-11-math-2]: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.686.444&rep=rep1&type=pdf (NTCIR-11 Math-2 Task Overview)
	[ntcir-12-mathir]: https://www.cs.rit.edu/~rlaz/files/ntcir12-mathir.pdf (NTCIR-12 MathIR Task Overview)		[ntcir-12-mathir]: https://www.cs.rit.edu/~rlaz/files/ntcir12-mathir.pdf (NTCIR-12 MathIR Task Overview)
			[user votes]: https://gitlab.fi.muni.cz/xnovot32/arqmath-data-preprocessing/-/blob/master/scripts/xml_to_qrels_tsv.py

scripts/.common.py.swp

0 → 100644

+12 KiB

File added.

No diff preview for this file type.

scripts/init.py

+1 −1

Original line number	Original line	Diff line number	Diff line
	from .common import get_judged_documents, ndcg		from .common import get_topics, get_judged_documents, ndcg

scripts/pycache/init.cpython-35.pyc

0 → 100644

+236 B

File added.

No diff preview for this file type.