Show HN: HF-agents, CLI extension to find the best model/quant for your hardware

https://github.com/huggingface/hf-agents
by clmnt • 4 months ago
2 0 4 months ago

We've been building out CLI extensions for the Hugging Face hub, and hf-agents is a fun one to share.

It uses llmfit under the hood to profile your hardware and automatically select the best-fit model and quantization — no manual GGUF hunting. It then launches a Pi Agent on top of it. One command, local, fully open.

If you've been using Claude Code or Codex CLI and want something that runs entirely on your own hardware/models, this is a nice lightweight alternative to try.

Happy to answer questions — and curious what hardware setups people are running this on.

Related Stories

Loading related stories...

Source preview

github.com