Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention
Paper
•
2405.17381
•
Published
Dong Li
liddalidd
AI & ML interests
None yet
Recent Activity
liked
a model
about 17 hours ago
MiniMaxAI/MiniMax-M2
upvoted
a
paper
4 months ago
MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning
Attention
upvoted
a
paper
5 months ago
Accelerate TarFlow Sampling with GS-Jacobi Iteration
Organizations
authored
2
papers
9 months ago
authored
6
papers
10 months ago
Fine-grained Audible Video Description
Paper
•
2303.15616
•
Published
•
1
CO2: Efficient Distributed Training with Full Communication-Computation Overlap
Paper
•
2401.16265
•
Published
•
1
Neural Architecture Search on Efficient Transformers and Beyond
Paper
•
2207.13955
•
Published
•
1
Linear Attention Sequence Parallelism
Paper
•
2404.02882
•
Published
•
3
HGRN2: Gated Linear RNNs with State Expansion
Paper
•
2404.07904
•
Published
•
20
Scaling Laws for Linear Complexity Language Models
Paper
•
2406.16690
•
Published
•
23