NewAgent platforms
BotPsy: On-Device Personal Assistant with a Sub-Billion-Parameter Agentic Language Model
Our short summary of Hugging Face’s engineering write-up. The full story, with all the detail, is on their blog.
Read the full write-up on huggingface.co (opens in a new tab)Problem
Cloud LLMs are expensive, unpredictable, and expose user data, while many tasks need only modest intelligence.
Solution
They built BotPsy, a 0.8 B‑parameter on‑device model that can call tools and act as a personal assistant for many everyday tasks.
Outperforms all models ≤1.2 B on tool‑use benchmarks
Want the architecture, code and numbers? They’re in the original post.
Read the full write-up on huggingface.co (opens in a new tab)
AWS