Skip to content

[Engine] Metal: moe_gu decodes gate then up rows for 3-4 token groups (MOE_SEQ); Q2_0/IQ2_XXS/IQ3_XXS only - #4377

Open
joseedson18jc wants to merge 1 commit into
Niko1221:mainfrom
joseedson18jc:metal-moe-gu-seq
Open

[Engine] Metal: moe_gu decodes gate then up rows for 3-4 token groups (MOE_SEQ); Q2_0/IQ2_XXS/IQ3_XXS only#4377
joseedson18jc wants to merge 1 commit into
Niko1221:mainfrom
joseedson18jc:metal-moe-gu-seq

Commits

  1. Commits on Oct 27, 2026