Skip to content

dsv41: the DeepInfer-style packed KV cache, on by default -- COLI_VK_KV_FP32=1 is the exact fp32 opt-out - #2712

Open
jameswitney wants to merge 61 commits into
JustVugg:devfrom
jameswitney:r2b/kv-quant-host
Open

jameswitney wants to merge 61 commits into
JustVugg:devfrom
jameswitney:r2b/kv-quant-host

Commits

  1. Commits on Nov 6, 2026

  2. Commits on Nov 8, 2026

  3. Commits on Nov 9, 2026

  4. Commits on Nov 10, 2026

  5. Commits on Nov 11, 2026

  6. Commits on Nov 12, 2026

  7. Commits on Nov 14, 2026

  8. Commits on Nov 15, 2026

  9. Commits on Nov 16, 2026