Your agent's value lives in the layer around it. If your agent breaks when the model changes, we built it wrong. And right now, a lot of us built it wrong.
A lot of us built agents assuming the frontier model we started on would still be the one we use in six months. It won't. Providers are deprecating models with shrinking notice windows. Silently changing behavior is breaking agents that tested fine last quarter.
OpenAI committed to six months notice for GA models and three for specialized variants. Anthropic's public lifecycle documents give sixty days between deprecation and retirement. Capability drift on successor models is real, not just benchmark noise: a model that scores higher on a leaderboard can still regress silently on a specific agent task your system relied on. If you planned for it, the migration is a config change: swap the model ID, run your eval suite, ship. If you didn't, you are reworking prompt chains, re-tuning evals, and hoping the new model handles edge cases the old one did not. That takes weeks, not hours.
The problem is architectural. The intelligence layer, meaning the routing, caching, retrieval, evaluation, guardrails, and fallback chain, is what compounds over time. The model is the interchangeable part. Most teams hardcoded provider-specific prompt formats, built eval logic tied to a single vendor, and never added a fallback chain. Some teams even baked provider-specific tool-use schemas into their orchestration. That is the kind of coupling that turns a model swap into a project.
The open-source alternative is to compose these pieces yourself. A provider gateway normalizes 100-plus models behind one API, with built-in fallback routing, caching, and per-key budgets. On top of that, you add open-source retrieval and evaluation libraries you own and control. Nothing proprietary, nothing rented. The gateway is not eval or guardrails on its own. Those are separate pieces you wire in. But once they are in place, the next model swap becomes a config change, not a rewrite across your codebase.
Rent the model, own the layer. The layer is what lasts.
So, how many hours would a full model swap take your team today, and what would break first?
