Skip to content

fix(gemini): report a CONTINUATION finish as Length - #1046

Open
wishborn wants to merge 1 commit into
prism-php:mainfrom
Particle-Academy:fix/gemini-continuation-length
Open

wishborn wants to merge 1 commit into
prism-php:mainfrom
Particle-Academy:fix/gemini-continuation-length

Conversation

@wishborn

Copy link
Copy Markdown
Contributor

Gemini's CONTINUATION finish reason means the per-request token limit was reached and generation is not complete. It had no case in FinishReasonMap and fell through to Other, so a caller checking FinishReason::Length to detect a cut-off answer never saw it, and a partial answer looked finished.

python-genai 2.30/2.31 turn automatic continuation on by default, so this is expected in normal use. Resuming with the continuation token is a separate capability and not part of this.

The test enters through Prism::text() and fails without the change. Three lines in the map, one test. Second of the smaller PRs out of #1028.

Gemini's CONTINUATION finish reason means the per-request token limit
was reached and generation is NOT complete. It had no case in
FinishReasonMap and fell through to Other, so a caller checking for
Length to detect a cut-off answer never saw it: a partial answer was
presented as a finished one.

python-genai 2.30/2.31 turn automatic continuation on by default, so
servers are expected to send this in normal use. Resuming with the
continuation token is a separate capability.

The test enters through Prism::text(), not the map, and fails without
the change.

Reported in the Particle-Academy/prism fork as #82.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant