SLTrain: a sparse plus low rank approach for parameter and memory efficient pretraining

Published in NeurIPS, 2024

Download paper here