The Ultra-Scale Playbook
🌌
3.72k
The ultimate guide to training LLM on large GPU Clusters
zuijiang
zuijiang
AI & ML interests
None yet
Recent Activity
upvoted a paper 7 days ago
veScale-FSDP: Flexible and High-Performance FSDP at Scale upvoted a paper about 1 month ago
CoBA-RL: Capability-Oriented Budget Allocation for Reinforcement Learning in LLMs upvoted a paper about 1 month ago
Good SFT Optimizes for SFT, Better SFT Prepares for Reinforcement Learning Organizations
liked a Space about 1 year ago
liked a dataset over 1 year ago
liked a Space over 1 year ago
liked a dataset almost 2 years ago