# Bonsai 27B: A 27B-Class Model That Runs on a Phone

The new AI model Bonsai 27B is the first 27B-class model capable of running on phones.

- **Source:** [Hacker News (news.ycombinator.com)](https://brifing.si/source/13c923cd-6d99-442b-9b8b-1181f4d8cd91)
- **Published:** 2026-07-14
- **Topic:** [Data & AI](https://brifing.si/c/data-ai)
- **Original article:** <https://prismml.com/news/bonsai-27b>
- **On Brifing:** https://brifing.si/s/b46253a5-99f3-4041-8945-c293662068e1

## The Revolutionary Feature of Bonsai 27B

Bonsai 27B is a multimodal AI model based on Qwen3.6 27B, the first 27B-class model that can run on phones. Unlike previous models, it supports multi-step reasoning, tool calls, and vision tasks. While traditional 27B models require 54GB, Bonsai 27B fits into just 3.9GB, making it phone-compatible.

## Two Distinct Variants

Bonsai 27B comes in two variants: Ternary Bonsai 27B and 1-bit Bonsai 27B. The Ternary variant, at 5.9GB, runs on everyday laptops, while the 1-bit variant, at just 3.9GB, fits devices like the iPhone 17 Pro. Both variants use low-bit weights and deliver high performance.

## Versatile Capabilities

Bonsai 27B offers a 262K-token context window and accelerated performance with speculative decoding. It excels in math, coding, tool calls, and vision tasks, achieving accuracy close to full-precision models, especially in math and coding benchmarks.

## Advantages of Local Execution

Bonsai 27B's ability to run locally ensures secure and fast AI processing without sending user data to the cloud. This is a major advantage for privacy-sensitive applications and offline workflows, enhancing both security and efficiency.

## Performance Comparison

Ternary Bonsai 27B retains 95% of full-precision model performance, while the 1-bit variant achieves 90%. It outperforms conventional low-bit models while using 2.5x less memory, enabling more efficient AI processing on local devices.

## Optimized for New AI Workloads

Bonsai 27B is optimized for continuous AI assistants rather than one-off responses. It seamlessly manages multi-step workflows and maintains privacy while processing user data, paving the way for next-gen AI applications.

## The Future of AI Architecture

Bonsai 27B is ideal for hybrid deployment models. Capable of running locally, it can integrate with cloud models for complex tasks, reducing costs while boosting performance and privacy. Bonsai 27B is a transformative step in shaping the future of AI.

## Sources covering this story

- https://prismml.com/news/bonsai-27b — 

---

_Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._
