Commit 2afb071e authored by Vít Novotný's avatar Vít Novotný
Browse files

Add random NDCG' to the leaderboards

parent 0823a28a
Loading
Loading
Loading
Loading
+2 −2
Original line number Original line Diff line number Diff line
@@ -30,7 +30,7 @@ Each task comes with three *subsets*:
#### Using the `train` set to train your supervised system
#### Using the `train` set to train your supervised system


``` sh
``` sh
$ pip install --force-reinstall git+https://gitlab.fi.muni.cz/xstefan3/arqmath-eval@0.0.4
$ pip install --force-reinstall git+https://gitlab.fi.muni.cz/xstefan3/arqmath-eval@0.0.5
$ python
$ python
>>> from arqmath_eval import get_topics, get_judged_documents, get_ndcg
>>> from arqmath_eval import get_topics, get_judged_documents, get_ndcg
>>>
>>>
@@ -58,7 +58,7 @@ Here is the documentation of the available evaluation functions:
#### Using the `validation` set to compare various parameters of your system
#### Using the `validation` set to compare various parameters of your system


``` sh
``` sh
$ pip install --force-reinstall git+https://gitlab.fi.muni.cz/xstefan3/arqmath-eval@0.0.4
$ pip install --force-reinstall git+https://gitlab.fi.muni.cz/xstefan3/arqmath-eval@0.0.5
$ python
$ python
>>> from arqmath_eval import get_topics, get_judged_documents
>>> from arqmath_eval import get_topics, get_judged_documents
>>>
>>>
+1 −0
Original line number Original line Diff line number Diff line
This table contains all results for user *ayetiran* in descending order of task
This table contains all results for user *ayetiran* in descending order of task
performance.  Result names are based on the filenames of the results with
performance.  Result names are based on the filenames of the results with
underscores (`_`) replaced with a comma and a space for improved readability.
underscores (`_`) replaced with a comma and a space for improved readability.
The random nDCG for this task is 0.7414.


| nDCG | Result name |
| nDCG | Result name |
|------|:------------|
|------|:------------|
+1 −0
Original line number Original line Diff line number Diff line
This table contains all results for user *xluptak4* in descending order of task
This table contains all results for user *xluptak4* in descending order of task
performance.  Result names are based on the filenames of the results with
performance.  Result names are based on the filenames of the results with
underscores (`_`) replaced with a comma and a space for improved readability.
underscores (`_`) replaced with a comma and a space for improved readability.
The random nDCG for this task is 0.7414.


| nDCG | Result name |
| nDCG | Result name |
|------|:------------|
|------|:------------|
+1 −0
Original line number Original line Diff line number Diff line
This table contains all results for user *xnovot32* in descending order of task
This table contains all results for user *xnovot32* in descending order of task
performance.  Result names are based on the filenames of the results with
performance.  Result names are based on the filenames of the results with
underscores (`_`) replaced with a comma and a space for improved readability.
underscores (`_`) replaced with a comma and a space for improved readability.
The random nDCG for this task is 0.7414.


| nDCG | Result name |
| nDCG | Result name |
|------|:------------|
|------|:------------|
+1 −0
Original line number Original line Diff line number Diff line
This table contains all results for user *xstefan3* in descending order of task
This table contains all results for user *xstefan3* in descending order of task
performance.  Result names are based on the filenames of the results with
performance.  Result names are based on the filenames of the results with
underscores (`_`) replaced with a comma and a space for improved readability.
underscores (`_`) replaced with a comma and a space for improved readability.
The random nDCG for this task is 0.7414.


| nDCG | Result name |
| nDCG | Result name |
|------|:------------|
|------|:------------|
Loading