Running Featured 1.21k FineWeb: decanting the web for the finest text data at scale 🍷 1.21k Generate high-quality text data for LLMs using FineWeb
Running 3.55k The Ultra-Scale Playbook 🌌 3.55k The ultimate guide to training LLM on large GPU Clusters
Running on CPU Upgrade Featured 2.55k The Smol Training Playbook 📚 2.55k The secrets to building world-class LLMs
Running Featured 39 Porting nanochat to Transformers: an AI modeling history lesson 📝 39 Learn about ML and Transformers through nanochat