Hugging Face's logo
nyq's picture

nyq

damax
·

AI & ML interests

None yet

Recent Activity

updated a dataset about 1 month ago
damax/damax
updated a dataset 9 months ago
damax/damax
reacted to anakin87's post with ➕ 12 months ago
🧰 Free up space on the Hub with `super_squash_history` 🧹 As you may know, Hugging Face Hub has storage limits on private repos (100 GB for free users, 1 TB for PROs). This weekend I did some cleanup on my private repos I went 1.58 TB down to 1 GB. 😅 Besides deleting old, unused models, the main tool I used was a lesser-known command: `super_squash_history`. When you train a model, you often push multiple checkpoints to the Hub. Each checkpoint = a commit. A 2.6B model in BF16 is ~5 GB. So 10 checkpoints = 50 GB. That adds up fast. While full commit history can be useful for rollbacks, it's often unnecessary for older experiments where only the final model matters. In these cases, you can use `super_squash_history`: it reduces your entire repo history to a single commit. https://huggingface.co/docs/huggingface_hub/main/en/package_reference/hf_api#huggingface_hub.HfApi.super_squash_history ⚠️ super_squash_history is a non-revertible operation. Once squashed, the commit history cannot be retrieved. Hope this is useful to others.
View all activity

Organizations

None yet