Skip to content

dsv41: the DeepInfer-style packed KV cache, on by default -- COLI_VK_KV_FP32=1 is the exact fp32 opt-out - #2712

Open
jameswitney wants to merge 61 commits into
JustVugg:devfrom
jameswitney:r2b/kv-quant-host
Open

jameswitney wants to merge 61 commits into
JustVugg:devfrom
jameswitney:r2b/kv-quant-host

Merge origin/dev into r2b/kv-quant-host

9e43e6c
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Container image
Started 2026-11-16 01:00:07 ago
Starting job