Running on CPU Upgrade Featured 2.73k The Smol Training Playbook ๐ 2.73k The secrets to building world-class LLMs
Running 3.6k The Ultra-Scale Playbook ๐ 3.6k The ultimate guide to training LLM on large GPU Clusters
CCI3.0-HQ: a large-scale Chinese dataset of high quality designed for pre-training large language models Paper โข 2410.18505 โข Published Oct 24, 2024 โข 11