Skip to content
GitLab
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Sign in
Toggle navigation
Menu
Open sidebar
Michal Štefánik
ARQMath-eval
Commits
aef18472
Commit
aef18472
authored
Apr 15, 2020
by
Vít Novotný
Browse files
Add common.get_random_ndcg (cont.)
parent
d9b73cb8
Changes
1
Hide whitespace changes
Inline
Side-by-side
test/test_get_random_ndcg.py
0 → 100644
View file @
aef18472
from
math
import
log2
import
unittest
from
arqmath_eval
import
get_random_ndcg
class
TestGetRandomNDCG
(
unittest
.
TestCase
):
def
test
(
self
):
ndcg
=
get_random_ndcg
(
'task1'
,
'test'
)
expected_judgement
=
(
4
*
3.0
+
4
*
2.0
+
8
*
1.0
+
2
*
0.0
)
/
18
expected_dcg
=
0.0
for
i
in
range
(
1
,
19
):
expected_dcg
+=
expected_judgement
/
log2
(
i
+
1
)
expected_idcg
=
0.0
for
i
in
range
(
1
,
5
):
expected_idcg
+=
3.0
/
log2
(
i
+
1
)
for
i
in
range
(
5
,
9
):
expected_idcg
+=
2.0
/
log2
(
i
+
1
)
for
i
in
range
(
9
,
17
):
expected_idcg
+=
1.0
/
log2
(
i
+
1
)
for
i
in
range
(
17
,
19
):
expected_idcg
+=
0.0
/
log2
(
i
+
1
)
expected_ndcg
=
expected_dcg
/
expected_idcg
self
.
assertEqual
(
expected_ndcg
,
ndcg
)
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment