An invented "because" passes a claim-by-claim grounding check
Two true facts joined by a made-up cause pass a claim-by-claim grounding judge.
SymptomAn agent's answer links two cited facts with "because" or "so", each fact checks out, and a sentence-level grounding check passes the answer.
Grounding judges check an answer's claims against its sources. An answer can join two claims that both check out with a cause the sources never state, and still pass.
"The deal slipped because the champion left" makes three claims, because the link is a claim too, alongside the slip and the departure. A judge that grades the sentence against its sources finds the first two and passes it.
A judge that lists claims before it decides will catch it. Before the verdict, it writes out each claim and the type of link between claims, so a cause with no source behind it becomes its own failing claim.
Dates don't need a model. Compute date relations in code before the judge runs, and "past due" on a date after the organization's as-of date fails on arithmetic, with no model call.
Take the 10 most recent answers your grounding judge passed that contain "because", "so" or "due to". Look in the cited sources for a source that states the causal link itself, not just the 2 facts. More than 1 of 10 with a link no source states means the judge misses invented causes.
Passes if9 or more of 10 sampled passed answers with a causal word cite a source that states the link itself.
Access needed:agent-transcriptscontext-read
- 01Have the judge list every claim and the type of link between claims before it gives a verdict.
- 02Grade each causal link as its own claim. Pass a causal link only if a source states the link.
- 03Compute date relations in code, such as before, after and past due. Hand the results to the judge.
- 04Fail any "past due" or "overdue" claim whose date is after the organization's as-of date, without a model call.