aiqbenchInformații despre AI & calcul cuantic

...

Română · beta. Traducerea a fost făcută automat și este încă în curs de revizuire. Citește pagina în engleză

perspectiva aiqbenchCipuri & infrastructură

Switchyard represents a significant infrastructural step for heterogeneous AI deployments by decoupling client agents from specific model backends through format translation and intelligent routing. As a Rust-based proxy, it enables coding agents like Claude Code or Codex CLI to interact seamlessly with diverse serving engines such as vLLM or Ollama without requiring code rewrites. While currently in pre-alpha status for evaluation purposes, this tool addresses the critical fragmentation issue where different LLM providers use incompatible API schemas, facilitating a more flexible ecosystem for AI development.

Sursă care acoperăMarkTechPost

Ce este aceastaLectura unui model asupra articolului și a acoperirii conexe, scrisă pentru aiqbench. Nu sunt cuvintele publicației.

Meet Switchyard: A Rust Proxy and Library That Routes and Translates LLM Traffic Across OpenAI and Anthropic APIs

MarkTechPost2 septembrie 20265 min de cititArticolul și perspectiva sunt în engleză.

NVIDIA has released Switchyard, an Apache-2.0 Rust proxy and library for LLM traffic. It decodes requests into provider-neutral types, routes them with passthrough, random, LLM-classifier, or stage-router algorithms, and translates responses back into the client's format, so Claude Code or Codex CLI can run against vLLM, NIM, or Ollama unchanged. The project is pre-alpha and not for production. The post Meet Switchyard: A Rust Proxy and Library That Routes and Translates LLM Traffic Across OpenAI and Anthropic APIs appeared first on MarkTechPost.

Teams running coding agents hit the same wall. Claude Code speaks the Anthropic Messages API, Codex CLI speaks OpenAI, and the model a team actually wants to serve sits behind vLLM, NVIDIA NIM, or Ollama. Rewriting the agent is not an option, so the translation layer has to live somewhere else. Switchyard is NVIDIA’s answer: a Rust proxy and library for LLM traffic that routes requests across providers, translates between OpenAI and Anthropic formats, records operational metrics, and exposes typed, composable routing…

Extras afișat conform termenilor RSS ai publicației · 82 cuvinte · textul integral și figurile sunt pe site-ul publicației

Citește pe MarkTechPost ↗Întreabă despre acest articol