Agents assume before acting and claim after, both without checking
Unchecked assumptions before acting and unchecked claims after made up 46% of my agents' errors.
SymptomYour agent replies done, live or verified in a turn where its transcript shows no tool call after your request.
When I classified four months of my agents' errors, the two biggest causes looked separate. One was wrong assumptions about state (a file, a field, a job, a flag). The other was claims of done or live made without checking.
They turn out to be one failure in two tenses, since the assumption comes before acting and the claim comes after. Together they accounted for 46% of 106 errors, and the classifiers judged that verifying before claiming would have prevented 43%.
That points at one mechanism instead of ten rules. A hook at the end of each turn flags any done, live, published or verified claim made with no tool call since the prompt that read the system it describes.
The Claude Code hooks reference lists Stop as an event whose exit code 2 prevents Claude from stopping and continues the conversation, so an end-of-turn check can send the agent back to work.
A second hook answers "didn't we already decide" from my decision log instead of from anyone's memory.
The measurement mattered as much as the gate. A zero-token regex miner flags candidate turns across every transcript in seconds, then blind classifiers label them. 61% of flagged episodes were noise.
Not every signal is equally trustworthy. How often each flag was a real error:
- The agent's own admission of an error: 69%.
- Challenges like "are you sure": 29%.
- My correction-shaped turns: 12%.
- My interrupts: 3%, because they are redirects rather than error reports.
Read your agent's last 20 replies in its transcripts that say done, live or verified. Count the replies with no tool call, between the request and the claim, that read the system the claim describes. More than 2 of 20 means claims are going out unchecked.
Passes if18 or more of 20 sampled done, live or verified claims follow a tool call that read the system described.
Access needed:agent-transcripts
- 01Flag any turn that claims done, live, published or verified with no qualifying tool call since the request. A qualifying tool call reads the system that the claim describes.
- 02Mine transcripts with a regex pass first. Send only flagged turns to a classifier.
- 03Weight the agent's own error admissions highest when counting errors.
- 04Do not count interrupts as errors.