Use Python 3.11 for FineWeb script | Generated by AI
Use python3.11 — it has huggingface_hub (0.28.1) installed and the script runs cleanly with it.
What’s on this box:
/usr/bin/python3→python3.12(nohuggingface_hub)/usr/bin/python3.11✅ hashuggingface_hub/home/linuxbrew/.linuxbrew/bin/python3.14(nohuggingface_hub)- No
python3.13anywhere — that’s why yourpythonshim failed.
Run it as:
python3.11 scripts/download/plan_and_download_fineweb_gpt3.py
If you’d rather make python work, either symlink it or install deps into 3.12:
python3.12 -m pip install -r requirements.txt
Generated by AI. Curating and sharing still takes effort.
If you find it useful, feel free to
donate.
WeChat: @lzwjava
·
X: @lzwjava ·
Say hi 👋