Hugging Face's logo

ArtusDev
/
ByteDance-Seed_BFS-Prover-V2-32B-EXL3

Text Generation
lean4
step-prover
exl3
Model card Files
xet
Community
ArtusDev commited on
Commit
666f05a
·
verified ·
1 Parent(s): 93a281e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +236 -29
README.md CHANGED
@@ -9,39 +9,246 @@ tags:
9
  - step-prover
10
  - exl3
11
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
 
13
- ## EXL3 Quants of ByteDance-Seed/BFS-Prover-V2-32B
14
 
15
- EXL3 quants of [ByteDance-Seed/BFS-Prover-V2-32B](https://huggingface.co/ByteDance-Seed/BFS-Prover-V2-32B) using <a href="https://github.com/turboderp-org/exllamav3/">exllamav3</a> for quantization.
 
 
 
 
 
16
 
17
- ### Quants
18
- | Quant(Revision) | Bits per Weight | Head Bits |
19
- | -------- | ---------- | --------- |
20
- | [2.5_H6](https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/2.5bpw_H6) | 2.5 | 6 |
21
- | [3.0_H6](https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/3.0bpw_H6) | 3.0 | 6 |
22
- | [3.5_H6](https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/3.5bpw_H6) | 3.5 | 6 |
23
- | [4.0_H6](https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/4.0bpw_H6) | 4.0 | 6 |
24
- | [5.0_H6](https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/5.0bpw_H6) | 5.0 | 6 |
25
- | [6.0_H6](https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/6.0bpw_H6) | 6.0 | 6 |
26
- | [8.0_H8](https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/8.0bpw_H8) | 8.0 | 8 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27
 
28
- ### Downloading quants with huggingface-cli
 
 
 
 
 
 
 
 
 
 
 
 
 
29
 
30
- <details>
31
- <summary>Click to view download instructions</summary>
 
 
 
 
 
 
 
32
 
33
- Install hugginface-cli:
 
 
 
 
 
34
 
35
- ```bash
36
- pip install -U "huggingface_hub[cli]"
37
- ```
38
-
39
- Download quant by targeting the specific quant revision (branch):
40
-
41
- ```
42
- huggingface-cli download ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3 --revision "5.0bpw_H6" --local-dir ./
43
- ```
44
- </details>
45
-
46
- ### Acknowledgements
47
- **Made possible with the help of cloud compute from [***lium.io***](https://lium.io/)**
 
9
  - step-prover
10
  - exl3
11
  ---
12
+ <style>
13
+ .container-dark {
14
+ font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", Arial, sans-serif;
15
+ line-height: 1.6;
16
+ color: #d4d4d4;
17
+ }
18
+ a {
19
+ color: #569cd6;
20
+ text-decoration: none;
21
+ font-weight: 600;
22
+ }
23
+ a:hover {
24
+ text-decoration: underline;
25
+ }
26
+ .card-dark {
27
+ background-color: #252526;
28
+ border-radius: 12px;
29
+ padding: 24px;
30
+ margin-bottom: 20px;
31
+ box-shadow: 0 4px 12px rgba(0,0,0,0.3);
32
+ border: 1px solid #3c3c3c;
33
+ }
34
+ .card-dark h1 {
35
+ font-size: 2.2em;
36
+ color: #ffffff;
37
+ text-align: center;
38
+ margin-bottom: 10px;
39
+ }
40
+ .card-dark.card-dark-title h1 {
41
+ font-size: 1.5em;
42
+ }
43
+ .card-dark .subtitle {
44
+ text-align: center;
45
+ font-size: 1.1em;
46
+ color: #a0a0a0;
47
+ }
48
+ .card-dark h2 {
49
+ font-size: 1.5em;
50
+ margin-top: 0;
51
+ padding-bottom: 10px;
52
+ border-bottom: 1px solid #3c3c3c;
53
+ color: #c586c0;
54
+ }
55
+ .card-dark h3 {
56
+ font-size: 1.2em;
57
+ color: #d4d4d4;
58
+ }
59
+ .styled-table {
60
+ display: table;
61
+ border: none;
62
+ width: 100%;
63
+ font-size: 0.95em;
64
+ margin-bottom: 0px;
65
+ }
66
+ .styled-table thead th {
67
+ background-color: #333333;
68
+ color: #c586c0;
69
+ text-align: left;
70
+ }
71
+ .styled-table th {
72
+ padding: 12px 15px;
73
+ }
74
+ .styled-table td {
75
+ padding: 0;
76
+ }
77
+ .styled-table table, .styled-table th, .styled-table td {
78
+ border-left: none;
79
+ border-right: none;
80
+ border-bottom: none;
81
+ }
82
+ .styled-table td {
83
+ border-bottom: 1px solid #3c3c3c;
84
+ }
85
+ .styled-table tbody tr {
86
+ transition: background-color 0.1s ease;
87
+ }
88
+ .styled-table tbody tr:hover {
89
+ background-color: #3a3a3a;
90
+ }
91
+ .styled-table tr:last-child td {
92
+ border-bottom: none;
93
+ }
94
+ .styled-table td a {
95
+ display: block;
96
+ padding: 12px 15px;
97
+ }
98
+ .styled-table td a.fake-link {
99
+ text-decoration:none;
100
+ color:inherit;
101
+ }
102
+ details {
103
+ margin-top: 20px;
104
+ border: 1px solid #3c3c3c;
105
+ border-radius: 8px;
106
+ overflow: hidden;
107
+ }
108
+ summary {
109
+ cursor: pointer;
110
+ padding: 12px 18px;
111
+ background-color: #6A5ACD;
112
+ font-weight: 600;
113
+ display: flex;
114
+ align-items: center;
115
+ gap: 10px;
116
+ justify-content: space-between;
117
+ list-style: none;
118
+ }
119
+ summary::-webkit-details-marker {
120
+ display: none;
121
+ }
122
+ summary:hover {
123
+ filter: brightness(1.1);
124
+ }
125
+ summary::after {
126
+ content: '';
127
+ display: inline-block;
128
+ width: 8px;
129
+ height: 8px;
130
+ border-bottom: 2px solid white;
131
+ border-right: 2px solid white;
132
+ transform: rotate(45deg);
133
+ transition: transform 0.3s ease;
134
+ }
135
+ details[open] > summary::after {
136
+ transform: rotate(225deg);
137
+ }
138
+ .details-content {
139
+ padding: 18px;
140
+ }
141
+ .btn-purple {
142
+ display: inline-block;
143
+ background-color: #6A5ACD;
144
+ color: white !important;
145
+ padding: 12px 24px;
146
+ border-radius: 8px;
147
+ text-decoration: none;
148
+ font-weight: 600;
149
+ transition: background-color 0.3s ease, transform 0.2s ease;
150
+ text-align: center;
151
+ }
152
+ .btn-purple:hover {
153
+ background-color: #7B68EE;
154
+ transform: translateY(-2px);
155
+ }
156
+ </style>
157
 
158
+ <div class="container-dark">
159
 
160
+ <div class="card-dark card-dark-title">
161
+ <h1>ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3</h1>
162
+ <p class="subtitle">
163
+ EXL3 quants of <a href="https://huggingface.co/ByteDance-Seed/BFS-Prover-V2-32B" target="_blank">ByteDance-Seed/BFS-Prover-V2-32B</a> using <a href="https://github.com/turboderp-org/exllamav3/" target="_blank">exllamav3</a> for quantization.
164
+ </p>
165
+ </div>
166
 
167
+ <div class="card-dark">
168
+ <h2>Quants</h2>
169
+ <table class="styled-table">
170
+ <thead>
171
+ <tr>
172
+ <th>Quant</th>
173
+ <th>BPW</th>
174
+ <th>Head Bits</th>
175
+ </tr>
176
+ </thead>
177
+ <tbody>
178
+ <tr>
179
+ <td><a href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/2.5bpw_H6" target="_blank">2.5_H6</a></td>
180
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/2.5bpw_H6" target="_blank">2.5</a></td>
181
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/2.5bpw_H6" target="_blank">6</a></td>
182
+ </tr>
183
+ <tr>
184
+ <td><a href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/3.0bpw_H6" target="_blank">3.0_H6</a></td>
185
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/3.0bpw_H6" target="_blank">3.0</a></td>
186
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/3.0bpw_H6" target="_blank">6</a></td>
187
+ </tr>
188
+ <tr>
189
+ <td><a href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/3.5bpw_H6" target="_blank">3.5_H6</a></td>
190
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/3.5bpw_H6" target="_blank">3.5</a></td>
191
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/3.5bpw_H6" target="_blank">6</a></td>
192
+ </tr>
193
+ <tr>
194
+ <td><a href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/4.0bpw_H6" target="_blank">4.0_H6</a></td>
195
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/4.0bpw_H6" target="_blank">4.0</a></td>
196
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/4.0bpw_H6" target="_blank">6</a></td>
197
+ </tr>
198
+ <tr>
199
+ <td><a href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/4.5bpw_H6" target="_blank">4.5_H6</a></td>
200
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/4.5bpw_H6" target="_blank">4.5</a></td>
201
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/4.5bpw_H6" target="_blank">6</a></td>
202
+ </tr>
203
+ <tr>
204
+ <td><a href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/5.0bpw_H6" target="_blank">5.0_H6</a></td>
205
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/5.0bpw_H6" target="_blank">5.0</a></td>
206
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/5.0bpw_H6" target="_blank">6</a></td>
207
+ </tr>
208
+ <tr>
209
+ <td><a href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/6.0bpw_H6" target="_blank">6.0_H6</a></td>
210
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/6.0bpw_H6" target="_blank">6.0</a></td>
211
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/6.0bpw_H6" target="_blank">6</a></td>
212
+ </tr>
213
+ <tr>
214
+ <td><a href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/8.0bpw_H8" target="_blank">8.0_H8</a></td>
215
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/8.0bpw_H8" target="_blank">8.0</a></td>
216
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3/tree/8.0bpw_H8" target="_blank">8</a></td>
217
+ </tr>
218
+ </tbody>
219
+ </table>
220
+ </div>
221
 
222
+ <div class="card-dark">
223
+ <h2>How to Download and Use Quants</h2>
224
+ <p>You can download quants by targeting specific size using the Hugging Face CLI.</p>
225
+ <details>
226
+ <summary>Click for download commands</summary>
227
+ <div class="details-content">
228
+ <b>1. Install huggingface-cli:</b>
229
+ <pre><code>pip install -U "huggingface_hub[cli]"</code></pre>
230
+ <b>2. Download a specific quant:</b>
231
+ <pre><code>huggingface-cli download ArtusDev/ByteDance-Seed_BFS-Prover-V2-32B-EXL3 --revision "5.0bpw_H6" --local-dir ./</code></pre>
232
+ </div>
233
+ </details>
234
+ <p>EXL3 quants can be run with any inference client that supports EXL3, such as <a href="https://github.com/theroyallab/tabbyapi" target="_blank"><b>TabbyAPI</b></a>. Refer to <a href="https://github.com/theroyallab/tabbyAPI/wiki/01.-Getting-Started" target="_blank">documentation</a> for set up instructions.</p>
235
+ </div>
236
 
237
+ <div class="card-dark">
238
+ <h2>Quant Requests</h2>
239
+ <div style="text-align: center; margin-top: 25px;">
240
+ <a href="https://huggingface.co/ArtusDev/requests-exl/discussions/new?title=[MODEL_NAME_HERE]&description=[MODEL_HF_LINK_HERE]" class="btn-purple" target="_blank">Request EXL3 Quants</a>
241
+ </div>
242
+ <p class="subtitle">
243
+ See <a href="https://huggingface.co/ArtusDev/requests-exl" target="_blank">EXL community hub</a> for request guidelines.
244
+ </p>
245
+ </div>
246
 
247
+ <div class="card-dark">
248
+ <h2>Acknowledgements</h2>
249
+ <p style="text-align: center; font-size: 1.1em; margin-top: 10px;">
250
+ Made possible with cloud compute from <a href="https://lium.io/" target="_blank"><b>lium.io</b></a>
251
+ </p>
252
+ </div>
253
 
254
+ </div>