Skip to content

Conversation

@jon-tow
Copy link
Member

@jon-tow jon-tow commented Jan 13, 2022

Also ensures the DATASET_PATH directory is created with parents.

@codecov
Copy link

codecov bot commented Jan 13, 2022

Codecov Report

Merging #256 (caff4f1) into master (0fe2e80) will decrease coverage by 0.23%.
The diff coverage is 87.24%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #256      +/-   ##
==========================================
- Coverage   95.76%   95.52%   -0.24%     
==========================================
  Files          45       46       +1     
  Lines        3731     3756      +25     
==========================================
+ Hits         3573     3588      +15     
- Misses        158      168      +10     
Impacted Files Coverage Δ
lm_eval/tasks/anli.py 100.00% <ø> (ø)
lm_eval/tasks/arc.py 100.00% <ø> (ø)
lm_eval/tasks/glue.py 96.44% <ø> (+0.24%) ⬆️
lm_eval/tasks/headqa.py 100.00% <ø> (ø)
lm_eval/tasks/hellaswag.py 100.00% <ø> (ø)
lm_eval/tasks/lambada.py 92.85% <ø> (-0.33%) ⬇️
lm_eval/tasks/lambada_cloze.py 100.00% <ø> (ø)
lm_eval/tasks/lambada_multilingual.py 94.00% <ø> (ø)
lm_eval/tasks/mathqa.py 100.00% <ø> (ø)
lm_eval/tasks/mc_taco.py 100.00% <ø> (ø)
... and 36 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update be40299...caff4f1. Read the comment docs.

@leogao2 leogao2 merged commit 4849702 into EleutherAI:master Jan 15, 2022
@jon-tow jon-tow deleted the update-asdiv branch January 15, 2022 04:25
qmdnls pushed a commit to qmdnls/lm-evaluation-harness that referenced this pull request Aug 17, 2023
Conform `asidv` to the new description api
LZY-the-boys pushed a commit to LZY-the-boys/lm-evaluation-harness-fast that referenced this pull request Sep 12, 2023
Conform `asidv` to the new description api
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants