Bonsai 27B: A 27B-Class Model That Runs on a Phone
The new AI model Bonsai 27B is the first 27B-class model capable of running on phones.
1The Revolutionary Feature of Bonsai 27B
Bonsai 27B is a multimodal AI model based on Qwen3.6 27B, the first 27B-class model that can run on phones. Unlike previous models, it supports multi-step reasoning, tool calls, and vision tasks. While traditional 27B models require 54GB, Bonsai 27B fits into just 3.9GB, making it phone-compatible.
2Two Distinct Variants
Bonsai 27B comes in two variants: Ternary Bonsai 27B and 1-bit Bonsai 27B. The Ternary variant, at 5.9GB, runs on everyday laptops, while the 1-bit variant, at just 3.9GB, fits devices like the iPhone 17 Pro. Both variants use low-bit weights and deliver high performance.
3Versatile Capabilities
Bonsai 27B offers a 262K-token context window and accelerated performance with speculative decoding. It excels in math, coding, tool calls, and vision tasks, achieving accuracy close to full-precision models, especially in math and coding benchmarks.
4Advantages of Local Execution
Bonsai 27B's ability to run locally ensures secure and fast AI processing without sending user data to the cloud. This is a major advantage for privacy-sensitive applications and offline workflows, enhancing both security and efficiency.
5Performance Comparison
Ternary Bonsai 27B retains 95% of full-precision model performance, while the 1-bit variant achieves 90%. It outperforms conventional low-bit models while using 2.5x less memory, enabling more efficient AI processing on local devices.
6Optimized for New AI Workloads
Bonsai 27B is optimized for continuous AI assistants rather than one-off responses. It seamlessly manages multi-step workflows and maintains privacy while processing user data, paving the way for next-gen AI applications.
7The Future of AI Architecture
Bonsai 27B is ideal for hybrid deployment models. Capable of running locally, it can integrate with cloud models for complex tasks, reducing costs while boosting performance and privacy. Bonsai 27B is a transformative step in shaping the future of AI.