view article Article Making Knowledge Distillation Cheap Enough to Run at Scale MultiverseComputingCAI • 15 days ago • 37
Running Featured 93 Distilling 100B+ Models 40x Faster with TRL 📝 93 TRL distillation for 100B+ teachers, 40x faster