10 min read—
BotPsy-0.8B: Tiny On-Device Agent Model That Out-Calls Tools
BotPsy-0.8B is a 0.8B-parameter agent model that runs fully on-device and beats a 2.5x larger model at tool calling. Run it locally with vLLM and llama.cpp.
All the articles with the tag "BotPsy".
BotPsy-0.8B is a 0.8B-parameter agent model that runs fully on-device and beats a 2.5x larger model at tool calling. Run it locally with vLLM and llama.cpp.