# Full offline voice agent in 1.2GB RAM: Executes commands instantly Your phone can now respond to voice commands in 0.9 seconds without internet - **Source:** [Developing Android Apps](https://brifing.si/source/aa76b6c1-28c1-49f8-967e-b6a0eeadfa86) - **Published:** 2026-07-18 - **Topic:** [Data & AI](https://brifing.si/c/data-ai) - **Original article:** - **On Brifing:** https://brifing.si/s/6fd70049-0d1b-4436-bc4a-3835a38ac3e2 ## On-Device Voice Technology The Speech-Android project developed a fully offline voice assistant. Voice detection with Silero VAD, speech-to-text with Parakeet STT, command understanding with FunctionGemma, and voice response with Pocket TTS - all processes occur on-device. Network is only needed for initial model downloads. ## Impressive Performance Tests on Galaxy S23 Ultra show the system transcribes speech in 217ms, understands commands in 294ms, and starts generating voice response in 179ms after speech ends. Total latency is just 908ms. The entire system uses 1.1GB memory. ## Technical Architecture Built with Kotlin SDK, the system works through a 250-line JNI bridge to a C++17 pipeline engine. Uses ONNX Runtime for speech models and LiteRT-LM for command routing. Available as open source under Apache-2.0 license. ## Smart Command Management The system only exposes tools valid for current device state, enabling reliable command routing even with a small 270M parameter model. This approach boosts performance while optimizing memory usage. ## User Experience Currently running as a foreground service holding continuous audio focus. The developer is considering implementing transient audio focus per turn, allowing media apps to duck rather than pause during voice interactions. ## Future of Mobile AI This project proves powerful AI models can run efficiently on mobile devices. Demonstrates the possibility of low-latency voice assistants without cloud dependency, crucial for privacy-focused users. Demo video and source code available on GitHub. ## Sources covering this story - https://www.reddit.com/r/androiddev/comments/1v07clk/a_full_offline_voice_agent_in_12_gb_of_ram_say_a/ — --- _Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._