Marktechpost iconMarktechpostSep 2, 2026

Meet Switchyard: A Rust Proxy and Library That Routes and Translates LLM Traffic Across OpenAI and Anthropic APIs

It decodes requests into provider-neutral types, routes them with passthrough, random, LLM-classifier, or stage-router algorithms, and translates responses back into the client's format, so Claude Code or Codex CLI can run against vLLM, NIM, or Ollama unchanged. NVIDIA has released Switchyard, an Apache-2.0 Rust proxy and library for LLM traffic.

Meet Switchyard: A Rust Proxy and Library That Routes and Translates LLM Traffic Across OpenAI and Anthropic APIs

Share this story

Send the public story page.

Useful takeaways from this story.

NVIDIA has released Switchyard, an Apache-2.0 Rust proxy and library for LLM traffic.

It decodes requests into provider-neutral types, routes them with passthrough, random, LLM-classifier, or stage-router algorithms, and translates responses back into the client's format, so Claude Code or...

Building the complete brief

The page is ready to read now. The fuller skim-friendly version will appear here automatically.

The useful part

NVIDIA has released Switchyard, an Apache-2.0 Rust proxy and library for LLM traffic. It decodes requests into provider-neutral types, routes them with passthrough, random, LLM-classifier, or stage-router algorithms, and translates responses back into the client's format, so Claude Code or Codex CLI can run against vLLM, NIM, or Ollama unchanged. The project is pre-alpha and not for production.

Details worth keeping

It decodes requests into provider-neutral types, routes them with passthrough, random, LLM-classifier, or stage-router algorithms, and translates responses back into the client's format, so Claude Code or Codex CLI can run against vLLM, NIM, or Ollama unchanged. The project is pre-alpha and not for production.

Keep reading in the app

Open the app view to save this story, compare related coverage, and continue from the same source.

Open in app