ComPEFT: Compression for Communicating Parameter Efficient Updates via Sparsification and QuantizationPrateek YadavLeshem Choshenet al.2025TMLR
A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative LearningPrateek YadavColin Raffelet al.2025TMLR
Efficient Methods for Natural Language Processing: A SurveyMarcos TrevisoJi-Ung Leeet al.2023Transactions of the Association for Computational Linguistics
ColD Fusion: Collaborative Descent for Distributed Multitask FinetuningShachar Don-YehiyaElad Venezianet al.2023ACL 2023