package versions，requirements.txt

[zhaoxiuzhuo]

Could you please clarify the exact package versions used? In particular, which version of datasets was used together with lm_eval?

[sixt99]

Yes please, I have been trying with different combinations of package versions but it's a nightmare

[namsengi11]

I am also facing the issue with versioning, would greatly appreciate if you could provide version information.

[MrGGLS]

The required package versions are already listed in the README:

torch==2.2.1
lm_eval==0.4.0 # provided in ./lm_eval

(And, I don't have the old python env anymore 😂)

[namsengi11]

For those still wondering, following combination of packages in combination of uv works.

"datasets==2.20.0",
"lm-eval[hf]==0.4.9.2",
"numpy==1.26.4",
"protobuf==6.33.4",
"sentencepiece==0.2.1",
"torch==2.2.1"

[zhaoxiuzhuo]

OK,Thank you.