ChuxiJ commited on
Commit
6b9fd82
ยท
verified ยท
1 Parent(s): 76fd462

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +98 -3
README.md CHANGED
@@ -1,3 +1,98 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: mit
4
+ pipeline_tag: text-to-audio
5
+ tags:
6
+ - audio
7
+ - music
8
+ - text2music
9
+ ---
10
+
11
+ <h1 align="center">ACE-Step 1.5</h1>
12
+ <h1 align="center">Pushing the Boundaries of Open-Source Music Generation</h1>
13
+ <p align="center">
14
+ <a href="https://ace-step.github.io/ace-step-v1.5.github.io/">Project</a> |
15
+ <a href="https://huggingface.co/collections/ACE-Step/ace-step-15">Hugging Face</a> |
16
+ <a href="https://modelscope.cn/models/ACE-Step/ACE-Step-v1-5">ModelScope</a> |
17
+ <a href="https://huggingface.co/spaces/ACE-Step/Ace-Step-v1.5">Space Demo</a> |
18
+ <a href="https://discord.gg/PeWDxrkdj7">Discord</a>
19
+ </p>
20
+
21
+
22
+ ![image](https://cdn-uploads.huggingface.co/production/uploads/62dfaf90c42558bcbd0a4f6f/b84r7t0viIw7rKSr_ja9_.png)
23
+
24
+ ## Model Details
25
+
26
+ ๐Ÿš€ **ACE-Step v1.5** is a highly efficient open-source music foundation model designed to bring commercial-grade music generation to consumer hardware.
27
+
28
+ ### Key Features
29
+
30
+ * **๐Ÿ’ฐ Commercial-Ready:** Unlike many models trained on ambiguous datasets, ACE-Step v1.5 is designed for creators. You can strictly use the generated music for **commercial purposes**.
31
+ * **๐Ÿ“š Safe & Robust Training Data:** The model is trained on a massive, legally compliant dataset consisting of:
32
+ * **Licensed Data:** Professionally licensed music tracks.
33
+ * **Royalty-Free / No-Copyright Data:** A vast collection of public domain and royalty-free music.
34
+ * **Synthetic Data:** High-quality audio generated via advanced MIDI-to-Audio conversion.
35
+ * **โšก Extreme Speed:** Generates a full song in under 2 seconds on an A100 and under 10 seconds on an RTX 3090.
36
+ * **๐Ÿ–ฅ๏ธ Consumer Hardware Friendly:** Runs locally with less than 4GB of VRAM.
37
+
38
+ ### Technical Capabilities
39
+
40
+ ๐ŸŒ‰ At its core lies a novel hybrid architecture where the Language Model (LM) functions as an omni-capable planner: it transforms simple user queries into comprehensive song blueprintsโ€”scaling from short loops to 10-minute compositionsโ€”while synthesizing metadata, lyrics, and captions via Chain-of-Thought to guide the Diffusion Transformer (DiT). โšก Uniquely, this alignment is achieved through intrinsic reinforcement learning relying solely on the model's internal mechanisms, thereby eliminating the biases inherent in external reward models or human preferences. ๐ŸŽš๏ธ
41
+
42
+ ๐Ÿ”ฎ Beyond standard synthesis, ACE-Step v1.5 unifies precise stylistic control with versatile editing capabilitiesโ€”such as cover generation, repainting, and vocal-to-BGM conversionโ€”while maintaining strict adherence to prompts across 50+ languages. This paves the way for powerful tools that seamlessly integrate into the creative workflows of music artists, producers, and content creators. ๐ŸŽธ
43
+
44
+ - **Developed by:** [ACE-STEP]
45
+ - **Model type:** [Text2Music]
46
+ - **Language(s):** [50+ languages]
47
+ - **License:** [MIT]
48
+
49
+ ## Evaluation
50
+
51
+ ![image](https://cdn-uploads.huggingface.co/production/uploads/62dfaf90c42558bcbd0a4f6f/n9aKi_NhSmlMOgmGzahZi.png)
52
+
53
+ ## ๐Ÿ—๏ธ Architecture
54
+
55
+
56
+ ![image](https://cdn-uploads.huggingface.co/production/uploads/62dfaf90c42558bcbd0a4f6f/V_d1rTdqkQyoSM8td7OWl.png)
57
+
58
+
59
+ ## ๐Ÿฆ Model Zoo
60
+
61
+
62
+ ![image](https://cdn-uploads.huggingface.co/production/uploads/62dfaf90c42558bcbd0a4f6f/B49V0OTKse_FRefTmTPsQ.png)
63
+
64
+ ### DiT Models
65
+
66
+ | DiT Model | Pre-Training | SFT | RL | CFG | Step | Refer audio | Text2Music | Cover | Repaint | Extract | Lego | Complete | Quality | Diversity | Fine-Tunability | Hugging Face |
67
+ |-----------|:------------:|:---:|:--:|:---:|:----:|:-----------:|:----------:|:-----:|:-------:|:-------:|:----:|:--------:|:-------:|:---------:|:---------------:|--------------|
68
+ | `acestep-v15-base` | โœ… | โŒ | โŒ | โœ… | 50 | โœ… | โœ… | โœ… | โœ… | โœ… | โœ… | โœ… | Medium | High | Easy | [Link](https://huggingface.co/ACE-Step/acestep-v15-base) |
69
+ | `acestep-v15-sft` | โœ… | โœ… | โŒ | โœ… | 50 | โœ… | โœ… | โœ… | โœ… | โŒ | โŒ | โŒ | High | Medium | Easy | [Link](https://huggingface.co/ACE-Step/acestep-v15-sft) |
70
+ | `acestep-v15-turbo` | โœ… | โœ… | โŒ | โŒ | 8 | โœ… | โœ… | โœ… | โœ… | โŒ | โŒ | โŒ | Very High | Medium | Medium | [Link](https://huggingface.co/ACE-Step/Ace-Step1.5) |
71
+ | `acestep-v15-turbo-rl` | โœ… | โœ… | โœ… | โŒ | 8 | โœ… | โœ… | โœ… | โœ… | โŒ | โŒ | โŒ | Very High | Medium | Medium | To be released |
72
+
73
+ ### LM Models
74
+
75
+ | LM Model | Pretrain from | Pre-Training | SFT | RL | CoT metas | Query rewrite | Audio Understanding | Composition Capability | Copy Melody | Hugging Face |
76
+ |----------|---------------|:------------:|:---:|:--:|:---------:|:-------------:|:-------------------:|:----------------------:|:-----------:|--------------|
77
+ | `acestep-5Hz-lm-0.6B` | Qwen3-0.6B | โœ… | โœ… | โœ… | โœ… | โœ… | Medium | Medium | Weak | โœ… |
78
+ | `acestep-5Hz-lm-1.7B` | Qwen3-1.7B | โœ… | โœ… | โœ… | โœ… | โœ… | Medium | Medium | Medium | โœ… |
79
+ | `acestep-5Hz-lm-4B` | Qwen3-4B | โœ… | โœ… | โœ… | โœ… | โœ… | Strong | Strong | Strong | โœ… |
80
+
81
+
82
+ ## ๐Ÿ™ Acknowledgements
83
+
84
+ This project is co-led by ACE Studio and StepFun.
85
+
86
+
87
+ ## ๐Ÿ“– Citation
88
+
89
+ If you find this project useful for your research, please consider citing:
90
+
91
+ ```BibTeX
92
+ @misc{gong2026acestep,
93
+ title={ACE-Step 1.5: Pushing the Boundaries of Open-Source Music Generation},
94
+ author={Junmin Gong, Yulin Song, Wenxiao Zhao, Sen Wang, Shengyuan Xu, Jing Guo},
95
+ howpublished={\url{https://github.com/ace-step/ACE-Step-1.5}},
96
+ year={2026},
97
+ note={GitHub repository}
98
+ }