Running on CPU Upgrade 192 The Synthetic Data Playbook: Generating Trillions of the Finest Tokens ๐ 192 Explore synthetic data benchmark results as an interactive bookshelf
Running 89 Unlocking On-Policy Distillation for Any Model Family ๐ 89 Visualize on-policy distillation for any model family
Running on CPU Upgrade Featured 3.05k The Smol Training Playbook ๐ 3.05k The secrets to building world-class LLMs
distilbert/distilbert-base-cased-distilled-squad Question Answering โข 65.2M โข Updated May 6, 2024 โข 237k โข โข 265
Running 3.74k The Ultra-Scale Playbook ๐ 3.74k The ultimate guide to training LLM on large GPU Clusters