Introducing Lumma-Fev-v2
• 15
AI & ML interests
Sovereign Superintelligence
Recent Activity
View all activity
Papers
Grouped Value Attention: Efficient KV Caching via On-Demand Key Reconstruction
Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention
Articles
Organization Card
FrontiersMind
Open research toward Sovereign Superintelligence.
We are a research lab working toward sovereign superintelligence. We believe the most capable models should be efficient enough for every organisation to own and run on its own hardware. So we design new architectures, pre-train our own models from scratch, and release our papers, weights and code openly.
Papers
- Grouped Value Attention · Sep 2026: about 45% fewer KV cache, with near GQA accuracy (FlashGVA coming soon).
- Grouped Query Experts · Jun 2026: matches all-active GQA with half the query heads active.
models 22
FrontiersMind/Lumma-fev-0.1B-v2
Text Classification • 0.2B • Updated • 56 • 3
FrontiersMind/Lumma-fev-4B-v2
Text Classification • 5B • Updated • 26 • 4
FrontiersMind/Lumma-fev-27B-v2
Text Classification • 26B • Updated • 80 • 4
FrontiersMind/Lumma-fev-27B
Text Classification • 26B • Updated • 231 • 26
FrontiersMind/Lumma-fev-27B-GGUF
Text Classification • 27B • Updated • 714 • 6
FrontiersMind/Lumma-fev-9b
Text Classification • 8B • Updated • 121 • 8
FrontiersMind/Lumma-fev-4b
Text Classification • 4B • Updated • 349 • 16
FrontiersMind/Lumma-fev-0.6b
Text Classification • 0.6B • Updated • 648 • 68
FrontiersMind/Lumma-fev-0.1b
Text Classification • 0.2B • Updated • 463 • 17
FrontiersMind/GVA
Updated • 6