The ATOM Report: Measuring the Open Language Model Ecosystem Paper β’ 2604.07190 β’ Published 8 days ago β’ 5
Running Featured 54 Distilling 100B+ Models 40x Faster with TRL π 54 TRL distillation for 100B+ teachers, 40x faster
view article Article Keep the Tokens Flowing: Lessons from 16 Open-Source RL Libraries +7 Mar 10 β’ 124
Running on CPU Upgrade 220 The Synthetic Data Playbook: Generating Trillions of the Finest Tokens π 220 Explore synthetic data experiments on a virtual bookshelf
view article Article Compute and Competition in AI: Different FlOPs for Different Folks Feb 12 β’ 14
view article Article πͺ Interpreto: A Unified Toolkit for Interpretability of Transformer Models Jan 20 β’ 37