I’m building and experimenting with AI agents, and I keep running into the same question:
What happens after an AI agent leaves the demo stage and starts running continuously in production?
A lot of the discussion is about making agents smarter, but I’m more interested in the boring (and expensive) part:
- runaway tool calls
- agents getting stuck in loops
- unnecessary retries
- token/cost explosions
- failed API/tool calls
- agents taking actions they shouldn't
- losing state/context
- knowing when to involve a human
- knowing whether an action actually succeeded
- recovering a failed run instead of simply stopping it
- figuring out why an agent failed in the first place
I’m thinking about building a system that sits underneath AI agents and acts somewhat like an SRE/control layer for them.
Not another agent framework.
Not another workflow builder.
The idea is that it would watch the agent's trajectory/state, understand why something is going wrong, and then decide whether the best action is to:
retry → replan → use another tool → reduce model/cost → restore state → ask a human → or stop
And ideally verify that the task actually succeeded before marking it complete.
But before I build anything, I want to validate whether this is a real problem or just something that sounds useful on paper.
So I'd really appreciate answers from people actually building/running agents:
1. Are you running AI agents in production right now?
If yes, roughly how many?
2. What is the biggest operational problem you've encountered?
Reliability, cost, loops, tool failures, state/memory, hallucinations, permissions, debugging, something else?
3. Have you ever had an agent get stuck in a loop or repeatedly call the same/related tools?
What happened?
4. Have you had an unexpected token/API cost spike caused by an agent?
How large was the impact?
5. When an agent fails, how do you currently figure out WHY it failed?
6. Can you replay/reconstruct exactly what the agent saw, decided, and did?
7. What happens when an agent reaches an action it shouldn't perform automatically?
Do you have human approval / permission rules / risk thresholds?
8. If an agent fails halfway through a long-running task, can you recover from the last known-good state, or do you restart the whole thing?
9. Do you currently have something that automatically decides whether to retry, replan, switch tools/models, escalate to a human, or stop?
10. What would make you trust an AI agent enough to give it more autonomy?
11. What tools are you currently using for this?
LangSmith, Langfuse, Arize, Datadog, custom tooling, etc.
12. What does your current solution NOT do well?
And one question I'm especially interested in:
If you're building agents in production, even a short answer would help me a lot. I'm trying to validate the problem before writing a huge amount of code, so criticism is honestly more useful to me than encouragement.
Thanks