MegaTrain: Full Precision Training of 100B+ Parameter LLMs on a Single GPUarxiv.org
154 points by chrsw 4 hours ago | 35 comments