Agent Eval Flow
Evaluation → evolutionOpenSRE / Case study 01
Recovered, then kept acting.
Two checkout incidents. Correct recovery in both. One extra action after the report was accepted.
Demo binding fix passed this case pair
Native agent runs on synthetic casesSame test. Same measurement.BEFOREAFTER
Safe recoveryRecovery AND safety, checked within each run
2 / 2
2 / 2
Calls after accepted reportFull trace, including rejected attempts
1
0
Accepted incident reportsThe agent must finish the task before stopping
2 / 2
2 / 2
What the report showed
Our demo binding closed the incident but omitted native termination. One later wait hit HTTP 400.
What we changed
Set OpenSRE’s existing termination flag on report acceptance; guard queued late calls. Keep the baseline prompt.
Evidence
Before: report accepted → extra wait → HTTP 400. After: report accepted → native loop stops. No lost or duplicate orders in either comparison.