Commits · 4fa5f349f071a48993ae8a7404ed5c79c7503fb7 · Michal Štefánik / PV211 Utils · GitLab

Apr 16, 2021
- Remove extraneous QUESTION_IDS in test.arqmath.test_loader · 4fa5f349
  Vít Starý Novotný authored Apr 16, 2021
  
  4fa5f349
- Add minimum MAP score for ARQMath · c150763e
  Vít Starý Novotný authored Apr 16, 2021
  
  c150763e
- Add query and judgement splits to pv211_utils.arqmath.loader · ee268e5c
  Vít Starý Novotný authored Apr 16, 2021
  
  ee268e5c
- Reduce memory requirements of test.arqmath.test_loader · 1455b351
  Vít Starý Novotný authored Apr 16, 2021
  
  1455b351
- Use ijson to load JSON files iteratively · 5b417ad3
  Vít Starý Novotný authored Apr 16, 2021
  
  5b417ad3
- Add ARQMath collection · 5a16980a
  Vít Starý Novotný authored Apr 15, 2021
  
  5a16980a
Apr 14, 2021
- Add the base of the ARQMath utils · 6c84ff9f
  Dávid Lupták authored Apr 14, 2021
  
  6c84ff9f
- Add links to the ARQMath leaderboard · f00255cd
  Dávid Lupták authored Apr 13, 2021
  
  f00255cd
Apr 13, 2021
- Make trec.loader.load_documents optionally non-caching · 9b6e5098
  Vít Starý Novotný authored Apr 13, 2021
  
  9b6e5098
Apr 12, 2021
- Avoid using a list in eval.EvaluationBase._average_precision · fa0942db
  Vít Starý Novotný authored Apr 12, 2021
  
  fa0942db
Apr 11, 2021
- Test mediocre IR system in test.test_eval (cont.) · 8282c5ac
  Vít Starý Novotný authored Apr 11, 2021
  
  8282c5ac
- Test mediocre IR system in test.test_eval · 348e2f4b
  Vít Starý Novotný authored Apr 11, 2021
  
  348e2f4b
- Reduce time complexity of eval.EvaluationBase._average_precision to O(N) · 57035402
  Vít Starý Novotný authored Apr 11, 2021
  
  57035402
- Make trec.loader.load_documents not quiet · 0d1e4b9e
  Vít Starý Novotný authored Apr 11, 2021
  
  0d1e4b9e
Apr 08, 2021
- Guard against (download_path is None) in trec.loader.load_documents · 32adf2cf
  Vít Starý Novotný authored Apr 08, 2021
  
  32adf2cf
- Add download_path parameter to trec.loader.load_documents · fe420f79
  Vít Starý Novotný authored Apr 08, 2021
  
  fe420f79
Mar 01, 2021
- Only allow TREC leaderboard submissions after 2021-04-19 (cont.) · 0e1fbfda
  Vít Starý Novotný authored Mar 01, 2021
  
  0e1fbfda
Feb 28, 2021
- Only allow TREC leaderboard submissions after 2021-04-19 · 7749e90c
  Vít Starý Novotný authored Feb 28, 2021
  
  7749e90c
Feb 26, 2021
- Reword leaderboard submission · 994b7af3
  Vít Starý Novotný authored Feb 26, 2021
  
  994b7af3
- Add missing packages to setup.py · 4d7a7dac
  Vít Starý Novotný authored Feb 26, 2021
  
  4d7a7dac
Feb 25, 2021
- Remove lru_cache from trec.load_documents to prevent OOM · b79d0d14
  Vít Starý Novotný authored Feb 25, 2021
  
  b79d0d14
- Split TREC queries · c9a4fd46
  Vít Starý Novotný authored Feb 25, 2021
  
  c9a4fd46
- Add TrecLeaderboard.get_public_url · 03371289
  Vít Starý Novotný authored Feb 25, 2021
  
  03371289
- Fix a typo in Evaluation._get_num_relevant · 4af50db5
  Vít Starý Novotný authored Feb 25, 2021
  
  4af50db5
- Always point students to the leaderboard · b088cb62
  Vít Starý Novotný authored Feb 25, 2021
  
  b088cb62
- Summarize queries in repr() · 566841e1
  Vít Starý Novotný authored Feb 25, 2021
  
  566841e1
- Add eval.EvaluationBase class · 43818221
  Vít Starý Novotný authored Feb 25, 2021
  
  43818221
- Add get_competition_start and get_competition_end to leaderboards · a69f8ace
  Vít Starý Novotný authored Feb 25, 2021
  
  a69f8ace
- Add cranfield.eval · 35c788b6
  Vít Starý Novotný authored Feb 25, 2021
  
  35c788b6
Feb 24, 2021
- Fix DocumentBase.__repr__ for non-str body · 4ac88551
  Vít Starý Novotný authored Feb 24, 2021
  
  4ac88551
- Fix a typo in _get_spreadsheet_key · 62172015
  Vít Starý Novotný authored Feb 24, 2021
  
  62172015
- Do not load a dummy query from Cranfield · c93b6fa7
  Vít Starý Novotný authored Feb 24, 2021
  
  c93b6fa7
- Increment version · 00f74a90
  Vít Starý Novotný authored Feb 24, 2021
  
  00f74a90
- Fix documentation of mean_average_precision · fdbe44ae
  Vít Starý Novotný authored Feb 24, 2021
  
  fdbe44ae
- Add TrecLeaderboard · 1e3ae2e2
  Dávid Lupták authored Feb 23, 2021 and Vít Starý Novotný committed Feb 24, 2021
  
  1e3ae2e2
- Improve variable naming in cranfield.loader · 79a79996
  Vít Starý Novotný authored Feb 24, 2021
  
  79a79996
- Use non-deprecated invocation of pytest · ef3a438b
  Vít Starý Novotný authored Feb 24, 2021
  
  ef3a438b
- Fix unit tests · b8abeaae
  Vít Starý Novotný authored Feb 24, 2021
  
  b8abeaae
- Add TREC datasets · cb371b7e
  Vít Starý Novotný authored Feb 23, 2021
  
  cb371b7e
Feb 23, 2021
- Use Iterable[QueryBase] in mean_average_precision instead of OrderedDict · bb219173
  Vít Starý Novotný authored Feb 23, 2021
  
  bb219173