KV Cache Compression 900000x Beyond TurboQuant and Per-Vector Shannon Limitarxiv.org
43 points by EGreg 3 hours ago | 36 comments