Skip to content

Fix empty result after Analyze (Qwen3 thinking, context overflow) - #5

Merged
kukirin-ui merged 1 commit into
mainfrom
fix/analyze-empty-output
Oct 14, 2026
Merged

kukirin-ui merged 1 commit into
mainfrom
fix/analyze-empty-output

Conversation

@kukirin-ui

Copy link
Copy Markdown
Owner

Qwen3 streamed its reasoning in reasoning_content (or <think> blocks), which the server ignored, so the 400-token budget was spent thinking and the UI got an empty stream and cleared the Working text.

  • Send chat_template_kwargs.enable_thinking=false + /no_think
  • Strip <think> blocks from content
  • Truncate page text to fit ctx_size (- answer budget)
  • Surface llama-server HTTP/stream errors and an explicit message when the answer is empty
  • UI keeps Working text until real output arrives, never shows blank

@kukirin-ui
kukirin-ui merged commit 0dfbee6 into main Oct 14, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant