Skip to content

Fix al-knowledge follow-ups and document the skill - #260

Merged
Jesper Schulz-Wedde (JesperSchulz) merged 1 commit into
mainfrom
jesperschulz-bc-knowledge-skill-review
Nov 4, 2026
Merged

Jesper Schulz-Wedde (JesperSchulz) merged 1 commit into
mainfrom
jesperschulz-bc-knowledge-skill-review

Conversation

@JesperSchulz

Copy link
Copy Markdown
Contributor

Addresses the medium-priority follow-ups from the post-v1.10 repository audit for the new al-knowledge skill (#222).

JavaScript consultations were filtered out before retrieval

al-knowledge declared technologies: [al]. Under READ's non-empty technology intersection, Entry dropped the only knowledge-query action whenever a caller supplied technologies: [javascript]. That rejected supported questions such as packaged control-add-in resource requests, even though BCQuality ships applicable JavaScript UI articles and al-ui-review already accepts [al, javascript].

  • microsoft/skills/knowledge/al-knowledge.md now declares technologies: [al, javascript].
  • Test-SkillIndex.ps1 asserts Entry admits knowledge-query with either technology. It fails against the previous frontmatter.

The validator accepted contradictory citation records

tools/validate_knowledge_response.py accepted an article cited in references and also listed in suppressed, and duplicate reference paths with contradictory applicability. The schema's uniqueItems compares whole objects, so it could not catch these.

  • The validator now rejects duplicate reference paths, duplicate suppression paths, and articles that are both cited and suppressed.
  • DO's knowledge-response contract states the invariant explicitly: each article path appears at most once across references[] and suppressed[]. The validation guide lists the new rejections.
  • Three new regression tests cover both suppression reasons and contradictory duplicate citations. All four cases fail against the previous validator.

Documentation omitted the new skill

  • docs/using-bcquality.md: the supplied-skill row and the /skills list check now include al-knowledge.
  • docs/troubleshooting.md: skill discovery checks all three skills. A new row covers answers without BCQuality citations, and no-knowledge from al-knowledge is explained as a coverage gap.

Validation

Frontmatter (0 errors), 12 schema cases, 33 semantic/CLI tests, skill index, knowledge index/retrieval, review fixtures with the changed-path gate, fixture-context regressions, and review contract checks all pass locally. Relative links in the edited files resolve.

The remaining gap, a reproducible answer-quality evaluation, is tracked in #259. #212 is intentionally left to its reporter.

- Admit JavaScript-only consultations: al-knowledge declares technologies [al, javascript], so Entry no longer filters out control add-in questions; Test-SkillIndex covers both technologies.
- Reject inconsistent citations: validate_knowledge_response.py rejects duplicate reference or suppression paths and articles that are both cited and suppressed. DO states the invariant; regression tests cover it.
- Document al-knowledge in using-bcquality.md and troubleshooting.md (skill discovery, explicit invocation, no-knowledge meaning).

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@JesperSchulz
Jesper Schulz-Wedde (JesperSchulz) merged commit a0a48d5 into main Nov 4, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant