# High-Performance AI Inference on the Web with LiteRT.js

Run AI models locally in web browsers with Google's LiteRT.js.

- **Source:** [Google Developers Blog](https://brifing.si/source/1e914d4a-9164-4a1a-82cb-3d169fbad877)
- **Topic:** [Data & AI](https://brifing.si/c/data-ai)
- **Original article:** <https://developers.googleblog.com/litertjs-googles-high-performance-web-ai-inference/>
- **On Brifing:** https://brifing.si/s/cdd56394-aa68-4c4e-9a9f-a5c324741b49

## What is LiteRT.js?

LiteRT.js is a JavaScript library announced by Google that enables AI models to run locally in web browsers. This enhances user privacy, eliminates server costs, and provides ultra-low latency for real-time experiences.

## Advantages Over TensorFlow.js

Unlike TensorFlow.js, LiteRT.js runs AI models with higher performance using WebAssembly. This makes deploying .tflite models to mobile and desktop browsers smoother than ever.

## Hardware Acceleration

LiteRT.js offers optimized acceleration for hardware like CPU, GPU, and NPU. Technologies such as XNNPACK, ML Drift, and WebNN ensure maximum performance for AI inference.

## Benefits for Developers

LiteRT.js makes it easy to integrate AI models into applications written in JavaScript or TypeScript. Complex tasks like text generation, object detection, and audio processing can be handled entirely client-side.

## Real-World Performance

LiteRT.js delivers significant speed improvements in classical computer vision and audio processing models compared to existing web solutions. It is up to 3x faster in CPU and GPU inference.

## Future Potential

LiteRT.js stands out as a technology that will shape the future of web-based AI applications. It offers developers faster, more secure, and more efficient AI solutions.

## Sources covering this story

- https://developers.googleblog.com/litertjs-googles-high-performance-web-ai-inference/ — 

---

_Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._
