Repository navigation
Interview skill: keep light-level interviews light - #60
Merged
Merged
Conversation
A live eval run on the hobby scenario (D1) inferred `light` correctly but pushed on 7 of 8 turns and once more at Review after the user asked to wrap up, taking 8 user turns against a target of 7. At light, push only when an answer misses the bar or contradicts an earlier one, aim for Review in about 6 turns, and don't spend a Review push at light or after a wrap-up request. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
Warning Review limit reached
This review includes 2 billable files and costs up to $0.50.
Reviews can continue after your included limit without a manual trigger. An admin must approve usage-based billing. Or wait 59 minutes for your next included review. View limit details
Comment |
4 tasks done
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
A live
/tempyr-evalrun on D1 (the side-project scenario) behaved well on substance:lightcorrectly.The judge flagged the burden, though. The interviewer pushed on 7 of 8 post-answer turns and made one more push at Review after the user said to lay it out. That made 8 user turns, against the light target of ≤7.
This tightens the skill (and the mirrored Codex skill):
Test plan
cargo test -p tempyr-cli(the skills are embedded).🤖 Generated with Claude Code