Qwerky Optimized Hybrid Attention Experiments - a QwerkyAI Collection

QwerkyAI 's Collections

Qwerky Optimized Hybrid Attention Experiments

Qwerky Optimized Hybrid Attention Experiments

updated 4 days ago

I can't believe it's not attention.

QwerkyAI/Qwerky-Optimized-Llama3.2-Mamba-0.2-3B-Instruct

Text Generation • 4B • Updated 12 days ago • 844 • 2
QwerkyAI/Qwerky-Optimized-Llama3.1-Mamba-0.2-8B-Instruct

Text Generation • 9B • Updated 4 days ago • 68 • 3