Skip to content

fix(evals): distinguish permission status from credential disclosures - #188

Merged
vriesd merged 13 commits into
mainfrom
fix/inspection-authorization-status
Oct 9, 2026
Merged

vriesd merged 13 commits into
mainfrom
fix/inspection-authorization-status

Conversation

@vriesd

@vriesd vriesd commented Oct 9, 2026 •

Copy link
Copy Markdown
Contributor

Inspection document capture rejected ordinary permission statements such as “Separate authorization is required before product repairs.” The global copular scanner treated the permission noun as a credential field before it reached the existing colon-permission policy.

This change examines each copular occurrence independently. Bare authorization can describe permission only in plain prose with a complete, bounded relation to task work. Credential values, aliases, ambiguous status words, quoted or coded contexts, and later disclosures remain unavailable. Mixed spaces and tabs are checked at both the field and predicate positions; ordinary unindented wrapping remains observable. LF, CRLF and CR share the same context rules. Blockquotes and their continuation lines remain private; quote-like output inside a closed code fence does not affect following plain prose.

The colon-assignment policy and public file, byte, hash and retention checks remain unchanged. Captured documents are preserved byte-for-byte. RED commits precede the fixes, and public file/snapshot regressions cover permission lifecycle statements, opaque values, independent later disclosures and the indentation family.

Validation passes on clean head fd174917. Full preflight passes 3,342 tests with 20 existing skips and zero failures. Independent review passes 240 public capture controls and 393 focused tests. Owner focused checks pass 345 tests. Exact-head comment audit passes. Fresh canonical packing reproduces the approved 9.6.0 tarball and full unpacked manifest; product bytes, release policy, case catalog and canonical plan are unchanged.

Original failed and operator-stopped campaigns remain immutable and receive no qualification credit. A fresh complete live qualification and genuine conditional canary remain required before release.

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 9, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-09T16:18:28.892629Z 5eaae88 PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 5eaae8801c

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread evals/harness.ts
@vriesd
vriesd merged commit ee18478 into main Oct 9, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants