Skip to content

[add] eval suite for the article-grammar skill - #139

Open
serhiipylypchuk1991 wants to merge 1 commit into
nextfrom
sp-next-eval-test-article-grammar
Open

[add] eval suite for the article-grammar skill#139
serhiipylypchuk1991 wants to merge 1 commit into
nextfrom
sp-next-eval-test-article-grammar

Conversation

@serhiipylypchuk1991

Copy link
Copy Markdown
Contributor
  • 30 fixtures across three tiers with 443 gold records: per-category micro cases, negative controls and composite pages
  • headless runner over the real CLI, prose-zone scorer, grading workflow
  • behavioral scenarios for the skill contract: target selection, no file modification, argument robustness
  • two baselines committed for comparison: v1.1.0 and v1.2.0
  • raw runs stay out of the repo, only summary baselines are tracked

- 30 fixtures across three tiers with 443 gold records: per-category
  micro cases, negative controls and composite pages
- headless runner over the real CLI, prose-zone scorer, grading workflow
- behavioral scenarios for the skill contract: target selection,
  no file modification, argument robustness
- two baselines committed for comparison: v1.1.0 and v1.2.0
- raw runs stay out of the repo, only summary baselines are tracked
@serhiipylypchuk1991 serhiipylypchuk1991 self-assigned this Aug 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant