A Self-Pruning Transformer: Extreme KV-Cache Compression w/Universal Attentionarxiv.org
6 points by matt_d 7 days ago | 0 comments