# Millwright: Self-Hosted LLM Router

Optimize cost and performance with Rust-based solution.

- **Source:** [Hacker News: Show HN](https://news.ycombinator.com)
- **Published:** 2026-07-22
- **Topic:** [Data & AI](https://brifing.si/c/data-ai)
- **Original article:** <https://github.com/Northwood-Systems/millwright>
- **On Brifing:** https://brifing.si/s/e14a03b0-dfa6-4f02-8c3a-022bb9417792

## What is Millwright?

Millwright is a Rust-based, self-hosted LLM router. It supports providers like OpenAI, Anthropic, and Amazon Bedrock. It focuses on cost savings, transparency, and performance. Easy to integrate with CLI interface.

## Features and Benefits

Millwright offers policy-controlled model roles, cheapest healthy route selection, and cache affinity. It provides detailed analysis like per-team costs, cache usage, and model/provider mix.

## Protocol and Support

Millwright supports protocols like OpenAI Chat Completions, Anthropic Messages, and text/tool translation. It offers role-scoped session lanes without serializing concurrent agent traffic.

## Cost Analysis

Millwright provides measured usage and model candidate economics analysis. It offers reports in HTML, Markdown, and JSON formats. Detailed analysis for cost savings.

## Reliability and Setup

Millwright offers reliability features like bounded failover, circuit breakers, timeouts, and concurrency limits. It provides interactive setup without storing provider secrets.

## Why Millwright?

Millwright optimizes cost and performance as a self-hosted solution. It is reliable and fast with its Rust-based structure. Offers easy integration and detailed analysis for developers.

## Sources covering this story

- https://github.com/Northwood-Systems/millwright — 

---

_Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._