Skip to content
GitLab
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Sign in
Toggle navigation
Menu
Open sidebar
Michal Štefánik
ARQMath-eval
Commits
a1439cf8
Commit
a1439cf8
authored
Jun 02, 2020
by
Vít Novotný
Browse files
Rename Mr. Random to xrando42
parent
2ecd25d9
Pipeline
#61725
failed with stage
Changes
7
Pipelines
2
Hide whitespace changes
Inline
Side-by-side
ntcir-11-math-2-main/README.md
View file @
a1439cf8
...
@@ -2,4 +2,4 @@ This table contains the best result for every user on the *ntcir-11-math-2-main*
...
@@ -2,4 +2,4 @@ This table contains the best result for every user on the *ntcir-11-math-2-main*
| nDCG | Result name | User |
| nDCG | Result name | User |
|:-----|:------------|------|
|:-----|:------------|------|
|
*0.6894*
|
*random*
|
*
Mr. R
ando
m
*
|
|
*0.6894*
|
*random*
|
*
xr
ando
42
*
|
ntcir-12-mathir-arxiv-main/README.md
View file @
a1439cf8
...
@@ -2,4 +2,4 @@ This table contains the best result for every user on the *ntcir-12-mathir-arxiv
...
@@ -2,4 +2,4 @@ This table contains the best result for every user on the *ntcir-12-mathir-arxiv
| nDCG | Result name | User |
| nDCG | Result name | User |
|:-----|:------------|------|
|:-----|:------------|------|
|
*0.6471*
|
*random*
|
*
Mr. R
ando
m
*
|
|
*0.6471*
|
*random*
|
*
xr
ando
42
*
|
ntcir-12-mathir-math-wiki-formula/README.md
View file @
a1439cf8
...
@@ -2,4 +2,4 @@ This table contains the best result for every user on the *ntcir-12-mathir-math-
...
@@ -2,4 +2,4 @@ This table contains the best result for every user on the *ntcir-12-mathir-math-
| nDCG | Result name | User |
| nDCG | Result name | User |
|:-----|:------------|------|
|:-----|:------------|------|
|
*0.7336*
|
*random*
|
*
Mr. R
ando
m
*
|
|
*0.7336*
|
*random*
|
*
xr
ando
42
*
|
scripts/evaluate.py
View file @
a1439cf8
...
@@ -24,7 +24,7 @@ if __name__ == '__main__':
...
@@ -24,7 +24,7 @@ if __name__ == '__main__':
for
task
in
TASKS
:
for
task
in
TASKS
:
random_ndcg
=
get_random_ndcg
(
task
,
'validation'
)
random_ndcg
=
get_random_ndcg
(
task
,
'validation'
)
users
=
glob
(
os
.
path
.
join
(
task
,
'*'
,
''
))
users
=
glob
(
os
.
path
.
join
(
task
,
'*'
,
''
))
task_results
=
[(
random_ndcg
,
'random'
,
'
Mr. R
ando
m
'
)]
task_results
=
[(
random_ndcg
,
'random'
,
'
xr
ando
42
'
)]
for
user
in
users
:
for
user
in
users
:
user
=
os
.
path
.
normpath
(
user
)
user
=
os
.
path
.
normpath
(
user
)
user_name
=
os
.
path
.
basename
(
user
)
user_name
=
os
.
path
.
basename
(
user
)
...
...
setup.py
View file @
a1439cf8
...
@@ -5,7 +5,7 @@ from setuptools import setup
...
@@ -5,7 +5,7 @@ from setuptools import setup
setup
(
setup
(
name
=
'arqmath_eval'
,
name
=
'arqmath_eval'
,
version
=
'0.0.1
0
'
,
version
=
'0.0.1
1
'
,
description
=
'Evaluation of ARQMath systems'
,
description
=
'Evaluation of ARQMath systems'
,
packages
=
[
'arqmath_eval'
],
packages
=
[
'arqmath_eval'
],
package_dir
=
{
'arqmath_eval'
:
'scripts'
},
package_dir
=
{
'arqmath_eval'
:
'scripts'
},
...
...
task1-votes/README.md
View file @
a1439cf8
...
@@ -5,4 +5,4 @@ This table contains the best result for every user on the *task1-votes* task.
...
@@ -5,4 +5,4 @@ This table contains the best result for every user on the *task1-votes* task.
| 0.7796 | sbert, validation, html-removal, exid9 | xstefan3 |
| 0.7796 | sbert, validation, html-removal, exid9 | xstefan3 |
| 0.7614 | prefix, phrases=2, alpha=0.05, bucket=2M, iter=5, max-n=6, min-alpha=0, min-count=5, min-n=3, negative=5, sample=0.0001, sg=1, size=300, window=5, dominant=True, nonzero-limit=800, symmetric=True, exponent=4.0, threshold=-1.0 | xnovot32 |
| 0.7614 | prefix, phrases=2, alpha=0.05, bucket=2M, iter=5, max-n=6, min-alpha=0, min-count=5, min-n=3, negative=5, sample=0.0001, sg=1, size=300, window=5, dominant=True, nonzero-limit=800, symmetric=True, exponent=4.0, threshold=-1.0 | xnovot32 |
| 0.7604 | prefix, phrases=2, alpha=0.1, dm=0, dm-concat=1, epochs=5, hs=0, min-alpha=0, min-count=5, negative=12, vector-size=300, window=8 | ayetiran |
| 0.7604 | prefix, phrases=2, alpha=0.1, dm=0, dm-concat=1, epochs=5, hs=0, min-alpha=0, min-count=5, negative=12, vector-size=300, window=8 | ayetiran |
|
*0.7578*
|
*random*
|
*
Mr. R
ando
m
*
|
|
*0.7578*
|
*random*
|
*
xr
ando
42
*
|
task1/README.md
View file @
a1439cf8
...
@@ -3,7 +3,7 @@ This table contains the best result for every user on the *task1* task.
...
@@ -3,7 +3,7 @@ This table contains the best result for every user on the *task1* task.
| nDCG | Result name | User |
| nDCG | Result name | User |
|:-----|:------------|------|
|:-----|:------------|------|
|
*0.8477*
|
*random*
|
*xstefan3*
|
|
*0.8477*
|
*random*
|
*xstefan3*
|
|
*0.8477*
|
*random*
|
*xrando42*
|
|
*0.8477*
|
*random*
|
*xnovot32*
|
|
*0.8477*
|
*random*
|
*xnovot32*
|
|
*0.8477*
|
*random*
|
*xluptak4*
|
|
*0.8477*
|
*random*
|
*xluptak4*
|
|
*0.8477*
|
*random*
|
*ayetiran*
|
|
*0.8477*
|
*random*
|
*ayetiran*
|
|
*0.8477*
|
*random*
|
*Mr. Random*
|
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment