Do transformers need three projections? Systematic study of QKV variantsarxiv.org
149 points by Anon84 8 hours ago | 30 comments