How to inject knowledge efficiently? Knowledge Infusion Scaling Law for Pre-training Large Language Models
Paper
•
2509.19371
•
Published
training
-
-
Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
Paper • 2505.06708 • Published • 4 -
Selective Attention: Enhancing Transformer through Principled Context Control
Paper • 2411.12892 • Published -
A Survey of Reinforcement Learning for Large Reasoning Models
Paper • 2509.08827 • Published • 185 -
d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning
Paper • 2504.12216 • Published • 3 -
Part I: Tricks or Traps? A Deep Dive into RL for LLM Reasoning
Paper • 2508.08221 • Published • 48 -
MiniMax-01: Scaling Foundation Models with Lightning Attention
Paper • 2501.08313 • Published • 298