Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment
Paper
•
2405.03594
•
Published
•
7
SNNs
-
-
Sparse Finetuning for Inference Acceleration of Large Language Models
Paper • 2310.06927 • Published • 15 -
SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
Paper • 2301.00774 • Published • 3 -
The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models
Paper • 2203.07259 • Published • 4 -
How Well Do Sparse Imagenet Models Transfer?
Paper • 2111.13445 • Published • 1