Repository navigation
docs(tasks): describe initial-load outcomes without session assumptions - #4
Closed
lanyue-llk wants to merge 1 commit into
Closed
lanyue-llk wants to merge 1 commit into
lanyue-llk wants to merge 1 commit into
Conversation
Contributor
Author
|
Closing this wording-only proposal after comparing it with merged #7, #10, #11 and #13. Its 385 prompt edits are not already merged, but prompts are execution inputs under the current versioning contract, so rewriting them also changes the frozen input edition. A new benchmark edition solely for these wording changes is unnecessary. The useful authoring guidance is retained in CONTRIBUTING through #8; frozen tasks and their published bindings remain intact. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
The public task text mixed the answer boundary with participant implementation assumptions. Phrases such as “fresh anonymous browser”, “do not log in”, “Browser Use actions”, and allowed parsing routes made the benchmark sound as if it prescribed how a Web Fetch implementation must work.
Web Fetch supplies a URL and evaluates the returned deliverable. The shared scope is the content available from the page's initial load; records that require clicking, scrolling, or pagination are outside that answer. Authentication mode and internal retrieval strategy are not task dimensions.
Change
This updates reader-facing text for 385 current task definitions. It makes no provider calls and does not change any saved result or score.
Example
Before:
After:
Validation
task_prompt, plus the shared popular-site source description; structured acceptance fields are unchanged.