Skip to content
GitLab
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Sign in
Toggle navigation
Menu
Open sidebar
Michal Štefánik
ARQMath-eval
Commits
7240dafe
Commit
7240dafe
authored
Apr 23, 2020
by
Vít Novotný
Browse files
Extend the README
parent
716c6d88
Pipeline
#58965
canceled with stage
Changes
1
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
README.md
View file @
7240dafe
...
...
@@ -37,7 +37,7 @@ Place your results in [the trec\_eval format][treceval-format] into the
following commands:
```
sh
$
pip
install
.
$
pip
install
git+https://gitlab.fi.muni.cz/xstefan3/arqmath-eval@master
$
python
>>>
from arqmath_eval import get_ndcg
>>>
from pytrec_eval import parse_run
...
...
@@ -55,11 +55,11 @@ dedicated directory *task/user*. To evaluate your results on the test set and
publish the results into the leaderboard, execute the following commands:
```
sh
$
git add task/user/result.tsv
# track your new result with Git
$
pip
install
.
# run the evaluation
$
python
-m
scripts.evaluate
$
git add
-u
# add the updated leaderboard to Git
$
git push
# publish your new result and the updated leaderboard
$
git add task/user/result.tsv
# track your new result with Git
$
pip
install
git+https://gitlab.fi.muni.cz/xstefan3/arqmath-eval@master
$
python
-m
scripts.evaluate
# run the evaluation
$
git add
-u
# add the updated leaderboard to Git
$
git push
# publish your new result and the updated leaderboard
```
[
arqmath-task1
]:
https://www.cs.rit.edu/~dprl/ARQMath/Task1-answers.html
(Task 1: Find Answers)
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment