Show HN: KVBoost – chunk-level KV cache reuse for HuggingFace, 5–48x faster TTFTpythongiant.github.io
18 points by pythongiant 4 hours ago | 15 comments