-
Notifications
You must be signed in to change notification settings - Fork 0
fix(sources): register publishers with RAG policy protection #2711
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
19 commits
Select commit
Hold shift + click to select a range
3bdd799
Register nine Australian clinical publishers in the source authority …
claude a025a1e
Merge origin/main into claude/register-australian-publishers
claude 87e43c3
Merge origin/main into claude/register-australian-publishers
claude ac21a2f
Protect the source authority register behind the RAG impact gate, and…
claude 9d84ed5
Consolidate publisher registration and source authority policy guard
BigSimmo 4f98a1e
fix(rag): refresh snapshot and cover publisher context ordering
BigSimmo 3a5d0a9
Merge origin/main into claude/register-australian-publishers
BigSimmo 31b7c95
Merge branch 'main' into claude/register-australian-publishers
BigSimmo cd692f4
Merge branch 'main' into claude/register-australian-publishers
BigSimmo 83057cf
Merge branch 'main' into claude/register-australian-publishers
BigSimmo 53607d8
Merge branch 'main' into claude/register-australian-publishers
BigSimmo e4113f4
Merge branch 'main' into claude/register-australian-publishers
BigSimmo 4599462
Merge branch 'main' into claude/register-australian-publishers
BigSimmo 7c3b34f
Merge branch 'main' into claude/register-australian-publishers
BigSimmo 1fb90b7
Merge origin/main into claude/register-australian-publishers
BigSimmo 1db5cc9
Merge branch 'main' into claude/register-australian-publishers
BigSimmo e6a1c89
Merge branch 'main' into claude/register-australian-publishers
BigSimmo 0f9fa3b
Merge branch 'main' into claude/register-australian-publishers
BigSimmo 6a599df
Merge branch 'main' into claude/register-australian-publishers
BigSimmo File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
14 changes: 14 additions & 0 deletions
14
docs/outstanding-issues-inbox/2054f3ed-afce-4be9-a7e2-88cdeb8b147c.json
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,14 @@ | ||
| { | ||
| "version": 2, | ||
| "id": "2054f3ed-afce-4be9-a7e2-88cdeb8b147c", | ||
| "createdOn": "2026-09-07", | ||
| "action": "add", | ||
| "payload": { | ||
| "pri": "P2", | ||
| "type": "issue", | ||
| "summary": "Weekly eval canary has failed on the same three answer-quality cases since at least 2026-08-23, and nothing tracks it", | ||
| "detail": "Golden retrieval passes throughout: run 34099357211 (2026-09-07, repository_dispatch) recorded cases=36, document_recall@5=1, content_recall@5=1, mrr@10=0.8921, zero failing retrieval cases. The run is red only because the separate live answer-quality subset fails its blocking threshold: 'RAG source_backed_review_fallback unaccounted' on clozapine-monitoring (high_confidence_extractive_retrieval; final_quality_gate:guidance_wrapper_fragment; extractive_quality_gate:provider_source_gap), clozapine-monitoring-paraphrase (identical signature), and nocc-requirements (strong_routine_retrieval; generation_fallback:generation_quality_failed; extractive_quality_gate:guidance_wrapper_fragment). The five most recent canary runs are all red: 34099357211, 34050934409 (scheduled), 33582708071, 33327352850 (scheduled), 32656925301 (scheduled, 2026-08-23). CONSEQUENCE: the canary is the pair-comparison instrument for every protected RAG change, and a permanently red run trains readers to ignore it. A future retrieval regression would land inside an already-red signal. NEXT: this is the same failure family as #J8SJQ9 (source-backed review stub where an authoritative source exists) but names different cases, so check that row for overlap before starting. First diagnostic step is whether generation was attempted at all for these three, exactly as #J8SJQ9 sets out. STOP: do not add acceptSourceOnly to these eval cases and do not relax the threshold to get the canary green. The retrieval half of the run remains a valid baseline in the meantime.", | ||
| "source": "Canary run logs 34099357211 and 34050934409, read during PR #2711 (source authority register), 2026-09-07", | ||
| "issueUlid": "01M1XSYJ9DSXPQ0A9B1TZ8J6NY" | ||
| } | ||
| } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.