Running on CPU Upgrade 282 The Synthetic Data Playbook: Generating Trillions of the Finest Tokens π 282 Explore synthetic data benchmarks with an interactive bookshelf
view article Article Finally, a Replacement for BERT: Introducing ModernBERT +13 bwarner, NohTow, bclavie, orionweller, ohallstrom, staghado, alexisgallagher, rbiswasfc, fladhak, tomaarsen, ncoop57, griffin, jph00, johnowhitaker, iacolippo β’ Dec 19, 2024 β’ 754
view article Article πͺ Introduction to Matryoshka Embedding Models +1 tomaarsen, Xenova, osanseviero β’ Feb 23, 2024 β’ 221
view article Article Gotchas in Tokenizer Behavior Every Developer Should Know qgallouedec β’ Apr 18, 2025 β’ 72
Running Featured 49 Porting nanochat to Transformers: an AI modeling history lesson π 49 Read an AI article with theme toggle and PDF download
view article Article Fine-tuning Florence-2 - Microsoft's Cutting-edge Vision Language Models +1 andito, merve, SkalskiP β’ Jun 24, 2024 β’ 210
view article Article SmolVLM - small yet mighty Vision Language Model +3 andito, merve, mfarre, eliebak, pcuenq β’ Nov 26, 2024 β’ 433
Running 96 Scaling FineWeb to 1000+ languages: Step 1: finding signal in 100s of evaluation tasks π 96 Evaluate multilingual models using FineTasks