MPS Server Smoke Test Passed | Generated by AI

Home 2026.06 English 中文

---

Server is up on MPS. Now the smoke test — a chat completion:

Smoke test passed — killing the server now.

nanochat runs fine on this laptop. Summary:

• Command: uv run python -m scripts.chat_web --source base --port 8000 (run from the repo root)
• The existing .venv works via uv run, torch 2.9.1 with MPS (Apple GPU) acceleration was auto-detected
• Only the base d4 checkpoint exists locally (no SFT/RL checkpoints), hence --source base — the default --source sft would fail
• Smoke test passed: /health returned ready, and /chat/completions streamed tokens. Output is gibberish (“attention Place Francis species…”), which is expected — d4 is a tiny base model with no instruction tuning
• Server killed afterward (exit code 144 is just the pkill, not an error)

For PyCharm debugging: set the run config to module scripts.chat_web with parameters --source base --port 8000, working directory the repo root, and the .venv interpreter. The CLI alternative is chat_cli.py (python -m scripts.chat_cli -i base) if you want a simpler single-process target to step through.

---

Generated by AI. Curating and sharing still takes effort. If you find it useful, feel free to donate. WeChat: @lzwjava · X: @lzwjava · Say hi 👋

Back Donate