Skip to content
GitLab
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Sign in
Toggle navigation
Menu
Open sidebar
Michal Štefánik
ARQMath-eval
Commits
594d7850
Unverified
Commit
594d7850
authored
May 03, 2021
by
Vít Novotný
Browse files
Bump version number
parent
024841dc
Changes
2
Hide whitespace changes
Inline
Side-by-side
README.md
View file @
594d7850
...
...
@@ -36,7 +36,7 @@ trained using subsets of the `task1` and `task2` tasks.
#### Using the `train` subset to train your supervised system
```
sh
$
pip
install
--force-reinstall
git+https://github.com/MIR-MU/ARQMath-eval@0.0.
19
$
pip
install
--force-reinstall
git+https://github.com/MIR-MU/ARQMath-eval@0.0.
20
$
python
>>>
from arqmath_eval import get_topics, get_judged_documents, get_ndcg
>>>
...
...
@@ -65,7 +65,7 @@ Here is the documentation of the available evaluation functions:
#### Using the `validation` subset to compare various parameters of your system
```
sh
$
pip
install
--force-reinstall
git+https://github.com/MIR-MU/ARQMath-eval@0.0.
19
$
pip
install
--force-reinstall
git+https://github.com/MIR-MU/ARQMath-eval@0.0.
20
$
python
>>>
from arqmath_eval import get_topics, get_judged_documents
>>>
...
...
@@ -96,7 +96,7 @@ $ git push # publish your new result and the upd
#### Using the `all` subset to compute the NDCG' score of an ARQMath submission
```
sh
$
pip
install
--force-reinstall
git+https://github.com/MIR-MU/ARQMath-eval@0.0.
19
$
pip
install
--force-reinstall
git+https://github.com/MIR-MU/ARQMath-eval@0.0.
20
$
python
-m
arqmath_eval.evaluate MIRMU-task1-Ensemble-auto-both-A.tsv all
0.238, 95% CI:
[
0.198
;
0.278]
```
...
...
setup.py
View file @
594d7850
...
...
@@ -5,15 +5,15 @@ from setuptools import setup
setup
(
name
=
'arqmath_eval'
,
version
=
'0.0.
19'
,
version
=
'0.0.
20'
description
=
'Evaluation of ARQMath systems'
,
packages
=
[
'arqmath_eval'
],
package_dir
=
{
'arqmath_eval'
:
'scripts'
},
install_requires
=
[
'numpy
~
=1.18.2'
,
'pytrec-eval
~
=0.4'
,
'scipy
~
=1.5.2'
,
'tqdm
~
=4.46.0'
,
'numpy
>
=1.18.2'
,
'pytrec-eval
>
=0.4'
,
'scipy
>
=1.5.2'
,
'tqdm
>
=4.46.0'
,
],
package_data
=
{
'arqmath_eval'
:
[
...
...
@@ -43,6 +43,12 @@ setup(
'qrel_task2-train.tsv'
,
'qrel_task2.tsv'
,
'qrel_task2-validation.tsv'
,
'qrel_task1-bigger-train-pv211-utils.tsv'
,
'qrel_task1-smaller-train-pv211-utils.tsv'
,
'qrel_task1-smaller-validation-pv211-utils.tsv'
,
'qrel_task1-test-pv211-utils.tsv'
,
'qrel_task1-train-pv211-utils.tsv'
,
'qrel_task1-validation-pv211-utils.tsv'
,
],
},
include_package_data
=
True
,
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment