The OpenAI-Compatible Gateway

One stable address in front of two correctly sized backends, with routing, failover, and health checks doing the work no client should have to.

Part of: Serving Open Models in Production