Abdulhakeem Adefioye

kokolamba's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted 2 papers 6 days ago

ReplaceMe: Network Simplification via Layer Pruning and Linear Transformations

Paper • 2505.02819 • Published May 5 • 26

Share Your Attention: Transformer Weight Sharing via Matrix-based Dictionary Learning

Paper • 2508.04581 • Published Aug 6 • 5

updated a model 8 days ago

kokolamba/moe-mha

Updated 8 days ago • 17

published a model 8 days ago

kokolamba/moe-mha

Updated 8 days ago • 17

updated a model 8 days ago

kokolamba/moe-kv-128

Updated 8 days ago • 17

published a model 8 days ago

kokolamba/moe-kv-128

Updated 8 days ago • 17

updated a model 8 days ago

kokolamba/moe-o-192

Updated 8 days ago • 11

published a model 8 days ago

kokolamba/moe-o-192

Updated 8 days ago • 11

upvoted an article 22 days ago

view article

Article

Sparse Mixture of Experts Language Model from Scratch: Extending makeMoE with Expert Capacity

By •

Mar 18, 2024

• 13

updated 8 models 27 days ago

kokolamba/SubspaceDecoder_mha

Updated 27 days ago • 51

kokolamba/SubspaceDecoder_mla192-0-0

Updated 27 days ago • 28

kokolamba/SubspaceDecoder_mla0-0-0

Updated 27 days ago

kokolamba/SubspaceDecoder_mla0-0-192

Updated 27 days ago • 33

kokolamba/SubspaceDecoder_mla0-96-192

Updated 27 days ago • 33

kokolamba/SubspaceDecoder_mla0-128-0

Updated 27 days ago • 27

kokolamba/SubspaceDecoder_mla192-96-192

Updated 27 days ago • 31

kokolamba/SubspaceDecoder_mla192-96-0

Updated 27 days ago • 39

published 3 models 27 days ago

kokolamba/SubspaceDecoder_mla192-0-0

Updated 27 days ago • 28

kokolamba/SubspaceDecoder_mla0-0-0

Updated 27 days ago

kokolamba/SubspaceDecoder_mla0-0-192

Updated 27 days ago • 33