Skip to content
GitLab
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Sign in
Toggle navigation
Menu
Open sidebar
Michal Štefánik
ARQMath-eval
Commits
f777489d
Commit
f777489d
authored
Aug 25, 2020
by
Vít Novotný
Browse files
evaluate_run @ evaluate.py: support for ranks starting at zero (cont.)
parent
69913b98
Pipeline
#62919
failed with stage
in 47 seconds
Changes
2
Pipelines
2
Hide whitespace changes
Inline
Side-by-side
README.md
View file @
f777489d
...
...
@@ -36,7 +36,7 @@ trained using subsets of the `task1` and `task2` tasks.
#### Using the `train` subset to train your supervised system
```
sh
$
pip
install
--force-reinstall
git+https://github.com/MIR-MU/ARQMath-eval@0.0.1
6
$
pip
install
--force-reinstall
git+https://github.com/MIR-MU/ARQMath-eval@0.0.1
7
$
python
>>>
from arqmath_eval import get_topics, get_judged_documents, get_ndcg
>>>
...
...
@@ -65,7 +65,7 @@ Here is the documentation of the available evaluation functions:
#### Using the `validation` subset to compare various parameters of your system
```
sh
$
pip
install
--force-reinstall
git+https://github.com/MIR-MU/ARQMath-eval@0.0.1
6
$
pip
install
--force-reinstall
git+https://github.com/MIR-MU/ARQMath-eval@0.0.1
7
$
python
>>>
from arqmath_eval import get_topics, get_judged_documents
>>>
...
...
@@ -96,7 +96,7 @@ $ git push # publish your new result and the upd
#### Using the `all` subset to compute the NDCG' score of an ARQMath submission
```
sh
$
pip
install
--force-reinstall
git+https://github.com/MIR-MU/ARQMath-eval@0.0.1
6
$
pip
install
--force-reinstall
git+https://github.com/MIR-MU/ARQMath-eval@0.0.1
7
$
python
-m
arqmath_eval.evaluate MIRMU-task1-Ensemble-auto-both-A.tsv all
0.238
```
...
...
setup.py
View file @
f777489d
...
...
@@ -5,7 +5,7 @@ from setuptools import setup
setup
(
name
=
'arqmath_eval'
,
version
=
'0.0.1
6
'
,
version
=
'0.0.1
7
'
,
description
=
'Evaluation of ARQMath systems'
,
packages
=
[
'arqmath_eval'
],
package_dir
=
{
'arqmath_eval'
:
'scripts'
},
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment