Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
615 commits
Select commit Hold shift + click to select a range
bf79dbb
AGENTS.md : revamp (#29656)
am17an Oct 4, 2026
7f2dd88
ci : add windows arm64 vulkan release (#29954)
CISC Oct 4, 2026
2e7c58c
ci : windows llvm build requires ninja multi-config (#29959)
CISC Oct 4, 2026
0eb6d9a
cuda : move neu_padded to where it is used (#29940)
angt Oct 4, 2026
a7b94df
ggml-cpu: support BF16/FP16/FP32 K tails in tinyBLAS on x86 (#29806)
SongXiaoXi Oct 4, 2026
2ca15f5
CUDA: refactor swizzling code (#29612)
JohannesGaessler Oct 4, 2026
0bb496d
llama: support both embd + raw tokens in batch (#29622)
ngxson Oct 4, 2026
a7fb71f
log, server: self contained colors, split child commands from logs in…
ServeurpersoCom Oct 4, 2026
d89651a
CUDA: prefer whole-tile FlashAttention scheduling for efficient two-s…
anujj Oct 5, 2026
9d3aba6
CUDA: use MMVF for thin f16/bf16 mul_mat at small batch size (#29633)
ynankani Oct 5, 2026
a3a1c47
metal : few-row MMA mat-mul (#29869)
pratiknarola-t Oct 5, 2026
1b43d31
cuda: tile the lightning indexer over keys and tokens for 4 heads (#2…
ServeurpersoCom Oct 5, 2026
8216c84
webgpu: add MMVQ support for Q1_0/Q5_0/Q5_1/Q3_K/Q5_K/Q6_K/MXFP4 (#29…
yomaytk Oct 5, 2026
ebe18be
vulkan : Fix undeclared identifiers when -DGGML_VULKAN_RUN_TESTS=ON (…
EAddario Oct 5, 2026
9f12cd4
ggml-cpu : add Q8_0 IME1 matrix kernel for SpacemiT X60 (#28479)
alanhc Oct 5, 2026
4ca6b76
ci : fix docker workflow permissions (#29979)
CISC Oct 5, 2026
e5983d6
ci : winget urls must be separate strings (#29978)
CISC Oct 5, 2026
2107910
kv-cache: fix restoring mismatched KV cache rotation by saving exact …
eapache Oct 5, 2026
c173a53
llama : fix unexpected graph reallocation in the k-pool models (#29958)
ggerganov Oct 5, 2026
b3daa07
vulkan: sparse flash attention for quantized K/V (#29639)
fxgsell Oct 5, 2026
806eee9
vulkan: fix stale prealloc_y reuse across flash attention and soft_ma…
fxgsell Oct 5, 2026
8e16421
server: reject partial media truncation (#24076)
he-yufeng Oct 5, 2026
2ed93db
ci : disable unused qemu in docker build (#29984)
CISC Oct 5, 2026
8b2fbaf
CUDA: Optimize accumulation in mmq for NVFP4 type (#29857)
kmorennv Oct 5, 2026
9871df5
server: support vision input for Clef (#29969)
ngxson Oct 5, 2026
8f9ae20
ci : disable failing test on virtual Metal device (#29993)
ggerganov Oct 5, 2026
9d853bb
webui: Use toLocaleString() format consistently across chat message s…
grivera64 Oct 5, 2026
994e8f2
ci : add "Require Docker" flag to make-release workflow (#29989)
ggerganov Oct 5, 2026
b809b88
cuda: use the vector lightning indexer kernel on MUSA (#29990)
ServeurpersoCom Oct 5, 2026
3c9e747
vulkan: revert mul_mat_id tile selection PR #29182 (#29936)
virajwad Oct 5, 2026
6c59c40
vulkan: fix Flash Attention shmem write out of bounds (#29988)
0cc4m Oct 5, 2026
e117148
CUDA: make the alloc_deps check batch independent (#29986)
am17an Oct 5, 2026
f05c8b2
ggml : bump version to 0.26.0 (ggml/1652)
ggerganov Oct 5, 2026
c06f841
sync : ggml
ggerganov Oct 5, 2026
4d60b4d
common, server : report model input/output modalities in GET /models …
angt Oct 5, 2026
d812350
llama.cpp : bump version to 0.6.0 (#29997)
ggerganov Oct 5, 2026
8345f33
hexagon: matmul and flash-atten scalability updates (#29974)
max-krasnyansky Oct 5, 2026
c250304
ci : skip container re-tagging when Require Docker is disabled (#30008)
ggerganov Oct 5, 2026
7049ff0
ci : add 1accel label [no ci] (#30016)
CISC Oct 5, 2026
50569eb
hexagon: add pool op support (#29995)
aparmp-quic Oct 5, 2026
5e03bdd
hexagon: ssm-conv updates (#29971)
tboinovski1 Oct 6, 2026
43fe9c6
llama: fix k-pool scatter data race on shared sequences (#29994)
ServeurpersoCom Oct 6, 2026
b9a5a00
ggml-openvino: fix CI tests; fix GPU regressions. (#30037)
ravi9 Oct 6, 2026
63bef27
vendor : update LibreSSL to 4.3.3 [no ci] (#30019)
cabelo Oct 6, 2026
cbb7d52
test-llama-archs : initialize backends before generating models (#30034)
booxter Oct 6, 2026
6753a03
ggml: refactor selective expert copying to user code (#29943)
am17an Oct 6, 2026
1a3011c
llama : re-reserve the sched when the nextn extraction flags change (…
pwilkin Oct 6, 2026
6c73b3e
convert : add text_config as fallback [transformers 5.18] (#30040)
frozenblade1224 Oct 6, 2026
d7a695e
scripts : limit apiabi checks to libllama and libmtmd (#30038)
danbev Oct 6, 2026
f0c41e0
models : consolidate nextn row cropping into shared helpers (#30017)
ggerganov Oct 6, 2026
4f54067
HIP: use -O0 for host code in debug builds (#29795)
JohannesGaessler Oct 6, 2026
58cb913
vulkan : check for null vkEnumerateInstanceVersion (#29872)
ianloic Oct 6, 2026
a043d38
metal : fix excess threadgroup memory in quantized flash attention (#…
masterFoad Oct 6, 2026
da263e7
models: support pplx-decider (#30044)
ngxson Oct 6, 2026
ab09ea4
cuda: BF16/FP16 conversion to f32 chunking (#29442)
thelittlefireman Oct 6, 2026
65840ed
ggml: fix CLAMP on non-contiguous views (CPU, CUDA) (#29517)
ServeurpersoCom Oct 6, 2026
a46709b
RPC: add `-sm tensor` (#26610)
am17an Oct 6, 2026
2207c8e
opencl: fix OOB read in adreno xmem GEMM (#30041)
lhez Oct 6, 2026
4fbc76d
model: support embeddinggemma2 (text+vision+audio) (#30054)
ngxson Oct 6, 2026
3109914
llama: remove the gather path of the glm5-next sparse attention (#30042)
ServeurpersoCom Oct 6, 2026
4625240
model : add K2 Horizon dense and MoVA support (#29535)
bitalov Oct 6, 2026
abeada3
vocab : implement PLaMo-3 tokenizer pre-segmentation (#30045)
tokinasin Oct 6, 2026
51ce9c1
ggml-cuda: use per-thread stream for buffer-init padding memset (#28782)
harkgill-amd Oct 6, 2026
5ad1c5d
cuda : add BF16 support for XIELU (#29955)
Qiao12-pixel Oct 6, 2026
c479922
hexagon: CPY/CONCAT/CONT/DUP overhaul to use DMA/HVX for all cases (#…
max-krasnyansky Oct 6, 2026
f498f86
ggml-webgpu: no dawn native features on wasi (#27069)
MendyBerger Oct 7, 2026
78651c4
sycl: add IQ3_S multi-column MMVQ (#29500)
clemenswasser Oct 7, 2026
4d756bc
vulkan: fix amd iGPU slow checkpoint read (#30049)
0cc4m Oct 7, 2026
5e5b628
sycl : fattn_kv_buffers cleanup (#27689)
Pratyush-gg Oct 7, 2026
d2a79e6
sycl: accelerate GLM MLA prefill with MKL flash attention (#29171)
anantshri Oct 7, 2026
005a1e1
[SYCL] fix the issue in mixed different model GPUs in FA (#29071)
arthw Oct 7, 2026
fa3c2fa
tests : retain the anchor when testing recurrent rollback (#29923)
eapache Oct 7, 2026
36a7391
ggml-webgpu: fix flash_attn supports_op check for overlapping KV (#28…
yomaytk Oct 7, 2026
2690873
imatrix : include clocale for std::setlocale (#30079)
dazzywi Oct 7, 2026
b7dafa0
vendor : update cpp-httplib to 0.60.0 (#30081)
cabelo Oct 7, 2026
ad21565
musa: use the tile lightning indexer kernel (#30080)
yeahdongcn Oct 7, 2026
7481354
convert : fix token configuration for PLaMo-3 (#29843)
tokinasin Oct 7, 2026
42b021b
vocab : add plamo fim tokens (#30090)
CISC Oct 7, 2026
d0b490f
sampling : use greedy selection for eligible temperature-zero chains …
hthadicherla Oct 7, 2026
48499d2
qwen3tts : guard speaker_encoder_config patch for CustomVoice variant…
SIDDARTHAREDDY8 Oct 7, 2026
b9acf13
feat: add GLM5Next MTP, optimize (#29928)
pwilkin Oct 7, 2026
7e8324f
metal : fix MUL_MAT+ADD fusion when the residual is itself a MUL_MAT …
nyo16 Oct 7, 2026
9881906
metal : few-row MMA mat-mul for the remaining src0 types (#30065)
pratiknarola-t Oct 7, 2026
448147d
llama: share the nextn tensor flags between models (#30097)
ServeurpersoCom Oct 7, 2026
18b5f8b
server : accumulate generated text and tokens as parse input (#29876)
aldehir Oct 7, 2026
42c787e
cuda: update uncoalesced memory reads in pool2d (#29425)
shenron0101 Oct 7, 2026
d6cf9ac
llama : add a GPU cache for MoE experts kept in host memory (#29887)
am17an Oct 7, 2026
50a6c5c
mtmd: add cohere2 vision support (#30062)
Terrencezzj Oct 7, 2026
b86d2f0
cuda: FWHT kernels for block widths above 512 (#29100)
bri-prism Oct 7, 2026
88dcc46
model : add LiquidAI/d1-3B decision model (#30110)
tdakhran Oct 7, 2026
5de7334
chat : name tool and argument parser rules by index (#30088)
Frost-54 Oct 7, 2026
bd4eeaa
chat: fix jinja parser for TranslateGemma (#30096)
nbud Oct 7, 2026
7081510
hexagon: improved GELU accuracy (#30104)
kurquhar Oct 7, 2026
aa5e009
hexagon: support tiled Q4_K and Q6_K GET_ROWS (#30115)
kurquhar Oct 8, 2026
a657f7e
model : add LiquidAI/d1-omni-600M decision model (#30114)
tdakhran Oct 8, 2026
06cad0b
hexagon: Q6_K weight dequant speedup (#30121)
kurquhar Oct 8, 2026
9c2e0e4
hexagon: enable alloc_buffer_n (#30126)
max-krasnyansky Oct 8, 2026
9b4ed0c
sycl: remove duplicate block-size defines from op headers (#29507)
Titaniumtown Oct 8, 2026
75118a3
convert : support Qwen3.5 embedding models (#27920)
SamMalayek Oct 8, 2026
847f447
sycl: add grouped MoE XMX GEMM (#29245)
cwriter Oct 8, 2026
24e4183
ggml-cuda: assign four GDN state columns per warp (#30087)
SongXiaoXi Oct 8, 2026
37ac634
model : support classifier_activation for rerankers (#29692)
boshjerns Oct 8, 2026
000bee5
sycl: stage bulk uploads (model loading) through a pinned ring buffer…
cwriter Oct 8, 2026
ff30363
sycl: fuse the delta-net alpha gate (add + unary + mul) (#29687)
Titaniumtown Oct 8, 2026
fda1866
CUDA: fix norm family kernels when ne[2]/ne[3] exceed grid dim limits…
edenfunf Oct 8, 2026
d888016
cuda : Use byte strides for roll to allow non-contiguous ROLL operati…
bertaye Oct 8, 2026
097f5b5
hex-mmadd: do not assume aligned read/write when bias-add is fused (#…
max-krasnyansky Oct 8, 2026
46baf1f
sycl: FWHT optimizations (#29605)
bri-prism Oct 8, 2026
08246a2
cuda : support arbitrary striding for unary ops on f16, f32, and bf16…
saady789 Oct 8, 2026
03aa006
vendor : update cpp-httplib to 0.60.1 (#30134)
angt Oct 8, 2026
dac3087
vulkan: extend sparse FA support to coopmat2 (#30003)
jeffbolznv Oct 8, 2026
ff5888f
vulkan : fix TOP_K for +inf/NaN inputs and k = 1 on negative values (…
gianni-cor Oct 8, 2026
033df86
server : preserve context checkpoints across slot save/restore (#26004)
Tough-Respawn Oct 8, 2026
c811cb8
llama: support MoE cache over multiple GPUs (#30112)
am17an Oct 8, 2026
4f92965
ui: apply ui_settings on first visit in router mode (#29668)
simonether Oct 8, 2026
1167d3f
CUDA: fix CCCL version guard breaking on major version rollover (#29453)
hey-gm Oct 8, 2026
c35b667
CUDA : looped PAD kernel for more than 65535 rows or slices (#30147)
pskrunner14 Oct 8, 2026
fc9ce6b
CUDA: fix MMQ out-of-bounds reads (#29953)
JohannesGaessler Oct 8, 2026
a11f57b
model : fix DFlash output head sharing (#30111)
hthadicherla Oct 8, 2026
71ad059
CUDA: improve top-k algorithm selection (#28713)
praneshgo Oct 8, 2026
de7fa0a
Musa FWHT fix (#30167)
bri-prism Oct 8, 2026
3d65c90
sycl : Q5_K reorder-layout MMVQ and fused GLU (#29375)
NickM-27 Oct 9, 2026
d4d82d6
hexagon: fix IM2COL patch-embed DMA ring overflow (#30189)
marktodorovich Oct 9, 2026
8a1a9b5
CUDA: pass src1 precision to host MMQ config helpers (#30168)
ynankani Oct 9, 2026
1f8fa52
metal: add the 128/96 flash attention kernels, accept every compiled …
ServeurpersoCom Oct 9, 2026
2c564f4
ci: fix HIP quality check by ignoring the 320/256 FA kernel spill (#3…
ServeurpersoCom Oct 9, 2026
b013e56
ui : add the models manager (#29583)
allozaur Oct 9, 2026
b42b7e6
server: use port 9931 by default (#30159)
ngxson Oct 9, 2026
5e1d740
ci : set run-name for publish release (#30214)
CISC Oct 9, 2026
e94acad
ci: fix Models Backend webgpu by supporting GGML_OP_DUP (#30216)
ServeurpersoCom Oct 9, 2026
86a2835
musa: drop mp_21 from the default architectures (#30203)
yeahdongcn Oct 9, 2026
609290b
convert : support compressed-tensor mixed-precision NVFP4 checkpoint …
ynankani Oct 9, 2026
5e4878e
vulkan: fix rms_norm workgroup count overflow (#30145)
0cc4m Oct 9, 2026
ba6439a
webgpu: use 2D workgroup dispatch for all the ops which use 1D dispat…
yomaytk Oct 9, 2026
e60eff9
meta : handle host views (#30217)
ggerganov Oct 9, 2026
8ae3867
ggml: fix OOB write in ggml_acc with negative offset (#30135)
Jasmine-tim Oct 9, 2026
a518119
llama: keep the backend sampling graph static across ubatches (#30223)
ServeurpersoCom Oct 9, 2026
8b54361
chat : refactor API (#30210)
aldehir Oct 9, 2026
6184e92
model : use exact GELU for ModernBERT encoders (#30108)
boshjerns Oct 9, 2026
64df918
opencl: fix kernel compilation for a6x GPUs (#30176)
jimmyzhouj Oct 9, 2026
50e3e3e
CUDA: Remove redundant CUDA copies after SSM_SCAN (#29807)
anavp-nvidia Oct 9, 2026
f39148a
llama-bench: respect -fitc if bigger than required benchmark size (#2…
MartinEmrich Oct 9, 2026
baef3ed
ui: Models Manager Follow-up Improvements (#30228)
allozaur Oct 9, 2026
8e2d31e
graph : reorder get_rows for embeddings (#30160)
ggerganov Oct 9, 2026
79e2e74
CUDA: fix round issue, under MSVC the CPU and GPU agree (#30229)
KafKafrnZ Oct 9, 2026
10a60cf
vendor: apply deep nested json patch from upstream (#30253)
ngxson Oct 9, 2026
1e6f04a
sycl : accelerate MXFP4 MoE with arithmetic decoding and weight reord…
Captain-Tripps Oct 10, 2026
f2918ca
opencl: add bin kernels kernel_gemm_moe_q4_k_q8_1_dp4a_bin, kernel_ge…
shawngu-quic Oct 10, 2026
b797c82
ggml: fix s390x all cpu build (#30140)
taronaeo Oct 10, 2026
404f557
vulkan: use 4 rows for NVIDIA MUL_MAT_ID MMVQ (#29274)
SG-Amadeus Oct 10, 2026
2bbca8f
ggml-cpu: vectorize fp32 to fp16 conversion (#30157)
taronaeo Oct 10, 2026
1bb2b9f
CUDA/HIP: fix race in flash_attn_ext_f16_process_tile when nbatch_com…
IMbackK Oct 10, 2026
1623d8c
cuda: always use MMVQ for MUL_MAT_ID on sm_60 (#27828)
dfriehs Oct 10, 2026
0fd868c
mtmd: add build_inp_attn_mask (#30259)
ngxson Oct 10, 2026
781dbc5
spec: properly handle mtmd input for mtp (#30257)
ngxson Oct 10, 2026
aa94f20
args: add LLAMA_ARG_SLOT_SAVE_PATH env for --slot-save-path (#30272)
kucharskim Oct 10, 2026
abee0c8
cmake(s390x): disable z17 target for unsupported compilers (#30297)
taronaeo Oct 10, 2026
69f201a
model : support MiniCPM-V 4.7 (#29416)
tc-mb Oct 10, 2026
23b0202
server: leave a busy slot untouched when a request pins it (#30295)
ServeurpersoCom Oct 10, 2026
62a6f74
server: add component tests (#30312)
ngxson Oct 11, 2026
966baae
vulkan: handle mul_mat_id duplicates in the prepass rather than loopi…
jeffbolznv Oct 11, 2026
1cf7767
cpu: fix AVX2 CPUs not using F16C when available (#30270)
xinitrcn1 Oct 11, 2026
a9d27ac
model : support for Prism Bonsai 2 27B (#29600)
bri-prism Oct 11, 2026
5c8854f
rpc : turn GGML_RPC_DEBUG into a verbosity level and add logs (#29544)
ggerganov Oct 11, 2026
c83f305
opencl: fix image limit for q4_k dense bin kernels, q4_0 bcast and rm…
lhez Oct 11, 2026
f2cc728
opencl: improve fa, allow dk512 for gemma-4, improve dk64 (#30266)
lhez Oct 11, 2026
b13a93a
hexagon: add IM2COL_3D (#30305)
kurquhar Oct 12, 2026
e937b17
hexagon: optimize q2_k bpw and activation (#30035)
jhen0409 Oct 12, 2026
b2f036c
vulkan: fix buffer logging on 32-bit platforms after source split (#3…
miyanyan Oct 12, 2026
a05e58c
ggml: Change default visibility of symbols to hidden (#30014)
ckastner Oct 12, 2026
08ffba2
vulkan: use ternary expressions to avoid switch lowering for CM2 quan…
SG-Amadeus Oct 12, 2026
f9a95ae
sycl: guard DMMV reads at row tails (#29338)
newjordan Oct 12, 2026
2f160ba
ui: fix text attachment preview overflow (#29898)
shamnadxyz Oct 12, 2026
972b5fc
llama : report compute graph reallocations during inference (#30329)
ggerganov Oct 12, 2026
77757a3
examples : fix draft sampling and rejection handling (#30095)
danbev Oct 12, 2026
073b740
metal : fix mul_mat_id with duplicate ids (#30373)
ggerganov Oct 12, 2026
ccdbe29
tests : link each test against only the libraries it uses (#30299)
ggerganov Oct 12, 2026
097cf33
model: support vllm decision 2 model (#30378)
ngxson Oct 12, 2026
efe3626
model: support vllm d3 models (#30383)
ngxson Oct 12, 2026
0f701c8
vulkan: pack FMA for f16 accumulation, no dot product op (#29877)
amitmi704 Oct 12, 2026
8bb3cf0
hexagon: optimize CPY/CONCAT — round 3, short-rows edition (#30341)
max-krasnyansky Oct 12, 2026
48e9857
metal: fix metal tensor kernel_mul_mm error for large tensor (#28748)
SecondSeed Oct 12, 2026
358a420
graph: pad the KV dimension of the no-cache attention to 256 (#30416)
ServeurpersoCom Oct 12, 2026
cbe28bb
model: fix vllm d3 multi seq case (#30408)
ngxson Oct 12, 2026
a49f58d
ci: fix OpenVINO download links (#30401)
Pratyush-gg Oct 13, 2026
8f574b0
ci : build OpenVINO releases with GGML_NATIVE=OFF and CPU backend var…
Pratyush-gg Oct 13, 2026
4413a19
hexagon: extend scalar DMA broadcasting support for binary ops (#30245)
kurquhar Oct 13, 2026
071b553
models : remove redundant ggml_cont calls now supported by all unary …
saady789 Oct 13, 2026
af50f2f
ggml-zdnn : introduce Q8_0 mat mul (#29836)
taronaeo Oct 13, 2026
9880157
graph : avoid reallocations in the "no cache" path (#30439)
ggerganov Oct 13, 2026
ed019cd
llama : skip logits buffer allocation when graph produces no logits (…
animeshsri14 Oct 13, 2026
9d7d504
convert : fix LoRA conversion with --outtype auto (#30433)
teddygood Oct 13, 2026
30f7df1
cuda : warnings cleanup (#30420)
angt Oct 13, 2026
882d671
cuda : fix warnings from dead breaks (#30441)
angt Oct 13, 2026
7f51953
model : allow Qwen3.8 Flash Next to accept image embds for MTP (#30397)
ORippler Oct 13, 2026
296538a
spec : remove tokens assert from dsv4 graph_mtp (#30444)
ORippler Oct 13, 2026
411d548
vulkan : split matmul dispatch when it would exceed maxComputeWorkGro…
losewayy Oct 13, 2026
bfe65e1
cuda : fix compiler warnings in mmq-load-tiles.cuh (#30443)
angt Oct 13, 2026
f851e24
cuda : add GGML_CUDA_GRAPH_DEBUG and read env vars once (#30327)
ggerganov Oct 13, 2026
0a731cc
ggml-cpu : add AVX2 dot product for Q2_0 (#30447)
homeofe Oct 13, 2026
e0bcacc
vulkan: allow multiple devices to access gpu-visible host memory (#29…
0cc4m Oct 13, 2026
b476d9a
llama : fix log message (#30452)
ggerganov Oct 13, 2026
a17e94d
tests : consolidate context state tests into test-llama-context (#30023)
ggerganov Oct 13, 2026
cb55ffe
graph: skip the LM head for pooled embeddings (#30445)
ServeurpersoCom Oct 13, 2026
f441d2d
model: load YaRN beta metadata for laguna models (#30331)
accaldwell Oct 13, 2026
b9f3599
llama : do not map foreign ranges into a backend buffer (#30405)
ggerganov Oct 13, 2026
ace20f6
graph: pad the KQ bias of the no-cache attention (#30446)
ServeurpersoCom Oct 13, 2026
ec0bfac
hexagon: add configurable HTP DCVS/HMX power mode (#30423)
pdhinaka Oct 13, 2026
ecdd29e
meta: recreate all subgraphs when the arena is reallocated (#30453)
Xanewok Oct 13, 2026
77c4540
vulkan: Optimize pool_2d when the pooling window is large (#30119)
jeffbolznv Oct 13, 2026
45451c3
kleidiai: add SME2 Q4_K and Q6_K matmul support (#29219)
chaxu01 Oct 13, 2026
d71e324
docs : update zDNN supported ops (#30472)
taronaeo Oct 13, 2026
1b70350
ggml : simplify backend search path error handling (#28367)
angt Oct 13, 2026
ff026f8
chat: replace output string with parts (#30389)
ngxson Oct 13, 2026
04f7226
server : escape the special tokens without std::regex (#30243)
ykhrustalev Oct 13, 2026
fcac190
webgpu: (Fix CI) fix mul_mat_id with duplicate expert ids (#30451)
yomaytk Oct 13, 2026
091b6a7
Enable OpenSSL in FP32/FP16 SYCL builds to restore HF HTTPS downloads…
raffaeleedidonna Oct 14, 2026
eca5458
convert : export YaRN truncation config (#30288)
tokinasin Oct 14, 2026
10da8c4
unicode : add opt-in NFC normalization for Unigram tokenizers (#30390)
sandrohanea Oct 14, 2026
7ec420b
vulkan: support mulmat bf16 activations (#29069)
0cc4m Oct 14, 2026
d524bb6
vulkan: Define the shader count for Intel Arc Pro B65 + B70 (#30431)
TheBlueMatt Oct 14, 2026
cdce056
vulkan: Add workaround for device free memory > total memory on Intel…
rillomas Oct 14, 2026
e7268bf
llama : build the k-pool selection in the causal mask layout (#30480)
ggerganov Oct 14, 2026
1431019
vulkan: fix compile error (#30495)
0cc4m Oct 14, 2026
4dd6dd4
HIP: use 64-row MMQ tiles for some quant types on RDNA3.5 (#28195)
liangliangchang Oct 14, 2026
9cf967a
models: drop the t_embd expand of the embedding graphs (#30461)
ServeurpersoCom Oct 14, 2026
21a19cd
opencl: fix q8_0 dp4a mul_mat_id and mark PREC_F32 mul_mat_id unsuppo…
lhez Oct 14, 2026
c5a9976
opencl: use buf+offset instead of subbuffer for adreno moe expert sor…
lhez Oct 14, 2026
77390ba
jinja : write floats in tojson as Python does (#30362)
ykhrustalev Oct 14, 2026
62bacfa
cuda : use SIMT implicit GEMM conv2d on AMD without WMMA (#30325)
aisk Oct 14, 2026
af0579c
ggml : improve RPC tensor transfer logs (#30481)
ggerganov Oct 14, 2026
3eb1013
vendor : update cpp-httplib to 0.61.0 (#30494)
angt Oct 14, 2026
df18bee
model: split layers evenly when no device reports free memory (#29677)
ServeurpersoCom Oct 14, 2026
8c2134a
ggml : add note about mul_mat_id + disable mul_mat_id_dup tests (#30501)
ggerganov Oct 14, 2026
318a471
docs : clarify installation recommendation for Intel oneAPI Toolkit (…
alosslessdev Oct 14, 2026
3fb4767
common : add --spec-draft-n-ubatch (#30459)
ggerganov Oct 14, 2026
6868a52
ggml: fix conv_1d result layout for batched input (#28738)
ServeurpersoCom Oct 14, 2026
37d6d65
skill: Update `code-review` skill for UI development (#30509)
allozaur Oct 14, 2026
62df181
cuda, hip: GDN chunked kernel (#29353)
am17an Oct 14, 2026
5cdadfc
ggml-cpu : size set_rows conversion buffer for all threads (#30454)
am17an Oct 14, 2026
c114bd4
docs: update IBM zDNN backend docs (#30527)
taronaeo Oct 14, 2026
685f708
ggml-cpu : keep the FP16->FP32 lookup table on x86 with F16C (#30342)…
Tough-Respawn Oct 14, 2026
529ac89
sycl: IQ3 code reorder (#29107)
anantshri Oct 14, 2026
683bbc0
gguf-py : detect nfc normalization (#30540)
CISC Oct 14, 2026
23deec0
devops: incorrect COPY instruction (#30529)
stormyhs Oct 14, 2026
a0e6dc7
opencl: support CLAMP on non-contiguous views (#30186)
wanghqc Oct 14, 2026
b7b9d43
Merge remote-tracking branch 'upstream/master' into jimwu.master-sync…
Oct 14, 2026
f0738d2
Merge pull request #149 from AMD-Ecosystem/jimwu.master-sync-upstream…
jimw567 Oct 16, 2026
7903942
Merge origin/master into gfx11 (sync 2026-10-16)
Oct 16, 2026
9c47b44
ggml-cuda: keep fused shared experts off the dq matvec path
Oct 16, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
5 changes: 3 additions & 2 deletions .devops/cann.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -145,7 +145,7 @@ ENTRYPOINT ["/app/tools.sh"]
# ==============================================================================
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

ENTRYPOINT [ "/app/llama-cli" ]

Expand All @@ -155,8 +155,9 @@ ENTRYPOINT [ "/app/llama-cli" ]
FROM base AS server

ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

HEALTHCHECK --interval=5m CMD [ "curl", "-f", "http://localhost:8080/health" ]

Expand Down
5 changes: 3 additions & 2 deletions .devops/cpu.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -104,7 +104,7 @@ ENTRYPOINT ["/app/tools.sh"]
### Light, CLI only
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -114,8 +114,9 @@ ENTRYPOINT [ "/app/llama-cli" ]
FROM base AS server

ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
5 changes: 3 additions & 2 deletions .devops/cuda.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -113,7 +113,7 @@ ENTRYPOINT ["/app/tools.sh"]
### Light, CLI only
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -123,8 +123,9 @@ ENTRYPOINT [ "/app/llama-cli" ]
FROM base AS server

ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
11 changes: 6 additions & 5 deletions .devops/intel.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
ARG ONEAPI_VERSION=2025.3.3-0-devel-ubuntu24.04
ARG ONEAPI_VERSION=2026.1.1-devel-ubuntu24.04
ARG BUILD_DATE=N/A
ARG APP_VERSION=N/A
ARG APP_REVISION=N/A
Expand All @@ -19,7 +19,7 @@ RUN npm ci
COPY tools/ui/ ./
RUN LLAMA_BUILD_NUMBER="$APP_VERSION" npm run build

FROM docker.io/intel/deep-learning-essentials:$ONEAPI_VERSION AS build
FROM docker.io/intel/oneapi-toolkit:$ONEAPI_VERSION AS build

ARG GGML_SYCL_F16=ON
ARG LEVEL_ZERO_VERSION=1.28.2
Expand Down Expand Up @@ -59,7 +59,7 @@ RUN mkdir -p /app/full \
&& cp requirements.txt /app/full \
&& cp .devops/tools.sh /app/full/tools.sh

FROM docker.io/intel/deep-learning-essentials:$ONEAPI_VERSION AS base
FROM docker.io/intel/oneapi-toolkit:$ONEAPI_VERSION AS base

ARG BUILD_DATE=N/A
ARG APP_VERSION=N/A
Expand Down Expand Up @@ -141,7 +141,7 @@ ENTRYPOINT ["/app/tools.sh"]
FROM base AS light

COPY --from=build /app/lib/ /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -151,9 +151,10 @@ ENTRYPOINT [ "/app/llama-cli" ]
FROM base AS server

ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/lib/ /app
COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
20 changes: 13 additions & 7 deletions .devops/musa.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,10 +1,9 @@
ARG UBUNTU_VERSION=22.04
# This needs to generally match the container host's environment.
ARG MUSA_VERSION=rc4.3.0
# Target the MUSA build image
ARG BASE_MUSA_DEV_CONTAINER=docker.io/mthreads/musa:${MUSA_VERSION}-devel-ubuntu${UBUNTU_VERSION}-amd64
ARG BASE_MUSA_DEV_CONTAINER=registry.mthreads.com/mcconline/musa_sdk:5.2.0-devel-ubuntu${UBUNTU_VERSION}-s5000

ARG BASE_MUSA_RUN_CONTAINER=docker.io/mthreads/musa:${MUSA_VERSION}-runtime-ubuntu${UBUNTU_VERSION}-amd64
ARG BASE_MUSA_RUN_CONTAINER=registry.mthreads.com/mcconline/musa_sdk:5.2.0-runtime-ubuntu${UBUNTU_VERSION}-s5000

ARG BUILD_DATE=N/A
ARG APP_VERSION=N/A
Expand Down Expand Up @@ -37,7 +36,10 @@ RUN apt-get update && \
python3-pip \
git \
libssl-dev \
libgomp1
libgomp1 \
musa-mualg-5-2 \
musa-muthrust-5-2 \
libmthreads-compute

WORKDIR /app

Expand Down Expand Up @@ -80,13 +82,16 @@ LABEL org.opencontainers.image.created=$BUILD_DATE \
org.opencontainers.image.source=$IMAGE_SOURCE

RUN apt-get update \
&& apt-get install -y libgomp1 curl ffmpeg \
&& apt-get install -y libgomp1 curl ffmpeg libmthreads-compute \
&& apt autoremove -y \
&& apt clean -y \
&& rm -rf /tmp/* /var/tmp/* \
&& find /var/cache/apt/archives /var/lib/apt/lists -not -name lock -type f -delete \
&& find /var/cache -type f -delete

# The MUSA runtime image does not register its library directory
RUN echo "/usr/local/musa/lib" > /etc/ld.so.conf.d/musa-runtime.conf && ldconfig

COPY --from=build /app/lib/ /app

### Full
Expand Down Expand Up @@ -115,7 +120,7 @@ ENTRYPOINT ["/app/tools.sh"]
### Light, CLI only
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -125,8 +130,9 @@ ENTRYPOINT [ "/app/llama-cli" ]
FROM base AS server

ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
13 changes: 7 additions & 6 deletions .devops/openvino.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
ARG OPENVINO_VERSION_MAJOR=2026.4
ARG OPENVINO_VERSION_FULL=2026.4.0.22959.99c81491cc3
ARG OPENVINO_VERSION_MAJOR=2026.4.1
ARG OPENVINO_VERSION_FULL=2026.4.1.22982.07f9c262b05
ARG UBUNTU_VERSION=24.04

# Intel GPU driver versions. https://github.com/intel/compute-runtime/releases
ARG IGC_VERSION=v2.40.13
ARG IGC_VERSION_FULL=2_2.40.13+22418
ARG COMPUTE_RUNTIME_VERSION=26.31.39395.13
ARG COMPUTE_RUNTIME_VERSION_FULL=26.31.39395.13-0
ARG IGC_VERSION=v2.41.5
ARG IGC_VERSION_FULL=2_2.41.5+22716
ARG COMPUTE_RUNTIME_VERSION=26.35.39758.10
ARG COMPUTE_RUNTIME_VERSION_FULL=26.35.39758.10-0
ARG IGDGMM_VERSION=22.10.0

# Intel NPU driver versions. https://github.com/intel/linux-npu-driver/releases
Expand Down Expand Up @@ -227,6 +227,7 @@ ENTRYPOINT [ "/app/llama-cli" ]
FROM base AS server

ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app/

Expand Down
5 changes: 3 additions & 2 deletions .devops/rocm.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -126,7 +126,7 @@ ENTRYPOINT ["/app/tools.sh"]
### Light, CLI only
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -136,8 +136,9 @@ ENTRYPOINT [ "/app/llama-cli" ]
FROM base AS server

ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
1 change: 1 addition & 0 deletions .devops/s390x.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -133,6 +133,7 @@ ENTRYPOINT [ "/llama.cpp/bin/llama-cli" ]
FROM base AS server

ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

WORKDIR /llama.cpp/bin

Expand Down
5 changes: 3 additions & 2 deletions .devops/vulkan.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,7 @@ ENTRYPOINT ["/app/tools.sh"]
### Light, CLI only
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -117,8 +117,9 @@ ENTRYPOINT [ "/app/llama-cli" ]
FROM base AS server

ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
5 changes: 3 additions & 2 deletions .devops/zendnn.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -97,7 +97,7 @@ ENTRYPOINT ["/app/tools.sh"]
### Light, CLI only
FROM base AS light

COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app
COPY --from=build /app/full/llama /app/full/llama-cli /app/full/llama-completion /app/

WORKDIR /app

Expand All @@ -107,8 +107,9 @@ ENTRYPOINT [ "/app/llama-cli" ]
FROM base AS server

ENV LLAMA_ARG_HOST=0.0.0.0
ENV LLAMA_ARG_PORT=8080

COPY --from=build /app/full/llama /app/full/llama-server /app
COPY --from=build /app/full/llama /app/full/llama-server /app/

WORKDIR /app

Expand Down
3 changes: 3 additions & 0 deletions .editorconfig
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,9 @@ insert_final_newline = unset
trim_trailing_whitespace = unset
insert_final_newline = unset

[vendor/**.patch]
trim_trailing_whitespace = unset

[tools/ui/**]
indent_style = unset
indent_size = unset
Expand Down
4 changes: 4 additions & 0 deletions .github/workflows/ai-issues.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,10 @@ on:
issues:
types: [opened]

cache-mode: none
permissions:
contents: read

jobs:
find-related:
if: github.event.action == 'opened'
Expand Down
4 changes: 4 additions & 0 deletions .github/workflows/build-3rd-party.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,10 @@ on:
'**/*.cpp'
]

cache-mode: none
permissions:
contents: read

concurrency:
group: ${{ github.workflow }}-${{ github.head_ref && github.ref || github.run_id }}
cancel-in-progress: true
Expand Down
20 changes: 18 additions & 2 deletions .github/workflows/build-and-test-snapdragon.yml
Original file line number Diff line number Diff line change
Expand Up @@ -23,19 +23,27 @@ on:
- 'scripts/snapdragon/**'
- 'CMakePresets.json'

cache-mode: none
permissions:
contents: read

concurrency:
group: ${{ github.workflow }}-${{ github.head_ref && github.ref || github.run_id }}
cancel-in-progress: true

jobs:
android-ndk-snapdragon:
runs-on: ubuntu-latest
runs-on: ubuntu-24.04 # previously ubuntu-latest
container:
image: 'ghcr.io/snapdragon-toolchain/arm64-android:v0.7'
defaults:
run:
shell: bash

permissions:
actions: write
contents: read

steps:
- name: Clone
uses: actions/checkout@v6
Expand All @@ -59,13 +67,17 @@ jobs:
path: pkg-snapdragon/llama.cpp

linux-iot-snapdragon:
runs-on: ubuntu-latest
runs-on: ubuntu-24.04 # previously ubuntu-latest
container:
image: 'ghcr.io/snapdragon-toolchain/arm64-linux:v0.7'
defaults:
run:
shell: bash

permissions:
actions: write
contents: read

steps:
- name: Clone
uses: actions/checkout@v6
Expand Down Expand Up @@ -98,6 +110,10 @@ jobs:
matrix:
device: [SM8750, SM8850, QCS9075M]

permissions:
actions: read
contents: read

steps:
- name: Checkout
uses: actions/checkout@v6
Expand Down
Loading
Loading