Speculative KV coding: losslessly compressing KV cache by up to ~4×fergusfinn.com
78 points by kkm 3 days ago | 12 comments