yeyucca 在 GLM 5.2本地部署,llama.cpp今日更新了add NextN/MTP speculative decoding support for GLM_DSA (GLM-5.2) 中发帖
本地部署GLM 5.2,可以捡到的decode红利,仅需将llama.cpp更新到最新release b10174版本以上
▶
Details
model: add NextN/MTP speculative decoding support for GLM_DSA (GLM-5.2) (#25980)
model: add NextN/MTP speculative decoding support for GLM_DSA (GLM-5.2)
Adds GLM-5.2 NextN/MTP as a --spec-type draft-mtp target: nextn tensor
loading via the qwen35moe/step35-style presence probe, a graph_mtp
builder (enorm/hnorm/eh_proj + d...