The same work runs again
Repeated requests inside one session, usually because the agent re-reads its own output with no completion limit.
Give every agent a track record, then scale the ones that earned it.
The same agent run, in full: root cause, evidence, and the verified improvement after the fix, the diagnostic report your team would see.
max_turns guard.max_turns: 6.A production agent is not a single model call. It is a chain of models, tools, retries and accumulated context, and one wasteful step pulls the steps after it along with it.
The agent still returns the right answer, so nothing in the logs looks broken, and the waste shows up only as a workflow that gets slower and heavier every week. Costile watches live traffic for these behaviours, and for short requests routed to an expensive model when a cheaper one would have answered identically.
Repeated requests inside one session, usually because the agent re-reads its own output with no completion limit.
A step retries against the same failing condition, and every attempt drags the calls that follow it into the same work.
Most of a session's calls come back as provider errors, so the agent keeps building on results that never actually arrived.
Calls stop at the token ceiling, which usually means output is being cut short and attempted again from the top.
Helicone and LangSmith record what your agent did, and stop there. That leaves your team to work out the cause, decide on a change, and guess whether it helped. Costile carries the same incident through all five steps.
Costile reads live traffic for the behaviours above, against rules with a named threshold you can see.
Every incident arrives with the cause named and the requests that prove it, so the conclusion can be checked rather than believed.
Costile names the specific change to make, such as a
max_turns guard on an agent re-reading its own
context.
Costile reads the runs that followed the fix and reports whether it held, or whether the agent still needs attention.
Each cycle adds to the agent's record, which is what tells you the ones that have earned more traffic.
We do not print a number out of a hundred. A score like that only means something against benchmark data across many agents, and nobody has that yet.
Costile reads the history as a direction instead. An agent is safe to scale only when it is healthy now and not degrading, because a healthy agent heading the wrong way is exactly the one you should not give more traffic to. Where a version has too little traffic to support a trend, Costile says so instead of showing one.
Error rate and max-token cutoffs both fell against the previous version, and the context loop closed with a fix Costile verified against the runs that followed it.
Error rate and cutoffs rose against the previous version and the last fix has not been verified, so Costile keeps this agent out of the safe-to-scale count until the trend turns.
Costile is for teams already running agents on live traffic, not for prototypes. Route a few production agents through it, see the first issues, and decide from evidence before adding broader governance.
Pick Individual or Team based on how many people need access, sign in with email and new password to create a workspace, and start the 10-day free trial without a card.
Send AI calls through Costile, review incidents and agent behavior, and only proceed to billing once the pilot proves the value.
Add payment details in Billing after the trial, manage your plan in Settings, and switch or cancel it at any time as team needs evolve.
Step two is one line of configuration. Costile mirrors the provider routes, so your existing calls keep working unchanged.
Replace - base_url = "https://api.anthropic.com"with + base_url = "https://api.costile.com"
For solo builders and operators improving production agents.
For teams needing governance, attribution, and shared operational evidence.
For organisations running agents across several teams, with procurement and security review.
node scripts/benchmark-latency.js reproduces it on your own hardware.
Danish-built evidence for AI operations: Costile supports Article 9 risk-management and Article 12 record-keeping evidence for teams in scope, with automatic audit logs, request attribution, and root-cause capture for every incident.
Read the EU AI Act compliance page →