All issues

[BUG] tool_calls silently null unless tool_format is explicitly configured (no error/warning)

#479

· cCoolBoox opened

on Sep 16, 2026

[DOCS] Running large MoE models under VRAM pressure: autosplit_reserve sizing, offload requirements, and worker tuning

#477

· sorasoras opened

on Sep 12, 2026

[REQUEST] exllamav3 backend: expose the missing MoE offload config surface (moe_cpu_split, draft_moe_cpu_layers)

#476

· sorasoras opened

on Sep 12, 2026

Stream partial tool_calls argument deltas for coding agents (parity with vLLM/llama.cpp)

#460

· tengotengo opened

on Sep 2, 2026

[BUG] SSE delivery is throttled to ~11 tokens/s regardless of generation speed; the response accumulates and flushes when generation ends

#457

· raikensan opened

on Aug 24, 2026

[REQUEST] I made a launcher for TabbyAPI

#455

· SaSteMi opened

on Aug 20, 2026

[REQUEST] Expose llama.cpp-style top-level `timings` and cached/draft token stats in OAI responses

#454

· dfein38347g opened

on Aug 19, 2026

[REQUEST] (bug?) Potential MTP prefill scheduling optimisation: deferred cache population improves long-context throughput ~43%

#451

· Britlion opened

on Aug 17, 2026

[REQUEST] Clarify sampler override file search mechanism

#419

· klement opened

on May 1, 2026

[REQUEST] Can't Set Context Length via front-end

#400

· zapshe opened

on Dec 6, 2025

[BUG] Default docker /dev/shm size too small for tensor parallelism to work

#387

· robfuscator opened

on Oct 11, 2025

[REQUEST] Enabling support for vision draft models.

#384

· MoetasimR opened

on Oct 5, 2025