Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximationarxiv.org
138 points by fheinsen 9 hours ago | 73 comments