A Closer Look into Mixture-of-Experts in Large Language Models
Paper
•
2406.18219
•
Published
•
17
Wee Kho
WeeKho
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
8 days ago
A Closer Look into Mixture-of-Experts in Large Language Models
upvoted
a
paper
8 days ago
Stealing User Prompts from Mixture of Experts
upvoted
a
paper
8 days ago
Mixture of Nested Experts: Adaptive Processing of Visual Tokens
Organizations
None yet
upvoted
8
papers
8 days ago
Stealing User Prompts from Mixture of Experts
Paper
•
2410.22884
•
Published
•
15
Mixture of Nested Experts: Adaptive Processing of Visual Tokens
Paper
•
2407.19985
•
Published
•
37
Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free
Paper
•
2410.10814
•
Published
•
51
Multilingual Routing in Mixture-of-Experts
Paper
•
2510.04694
•
Published
•
3
Every Attention Matters: An Efficient Hybrid Architecture for Long-Context Reasoning
Paper
•
2510.19338
•
Published
•
101
Language Models are Injective and Hence Invertible
Paper
•
2510.15511
•
Published
•
61
Attention Sinks in Diffusion Language Models
Paper
•
2510.15731
•
Published
•
47
upvoted
an
article
8 days ago
Article
Sentence Transformers is joining Hugging Face!
•
72