Add pipeline tag, library name, and paper link to metadata

#3
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +12 -511
README.md CHANGED
@@ -1,9 +1,13 @@
1
  ---
2
- license: apache-2.0
3
  language:
4
  - en
5
  - zh
 
 
 
 
6
  ---
 
7
  <p align="center">
8
  <img src="./assets/logo.png" width="600"/>
9
  <p>
@@ -16,7 +20,8 @@ language:
16
  <p align="center" style="line-height: 1;">
17
  🤗 <a href="https://huggingface.co/FireRedTeam/FireRed-Image-Edit-1.0">HuggingFace</a> |
18
  🖥️ <a href="https://huggingface.co/spaces/FireRedTeam/FireRed-Image-Edit-1.0"> Demo</a> |
19
- 📄 <a href="https://github.com/FireRedTeam/FireRed-Image-Edit/blob/main/assets/FireRed_Image_Edit_1_0_Techinical_Report.pdf">Technical Report</a>
 
20
  </p>
21
  <p align="center">
22
  <img src="./assets/teaser.png" width="800"/>
@@ -24,7 +29,7 @@ language:
24
 
25
 
26
  ## 🔥 FireRed-Image-Edit
27
- **FireRed-Image-Edit** is a general-purpose image editing model that delivers high-fidelity and consistent editing across a wide range of scenarios.
28
 
29
  ## ✨ Key Features
30
  - **Strong Editing Performance**: FireRed-Image-Edit delivers leading open-source results with accurate instruction following, high image quality, and consistent visual coherence.
@@ -36,10 +41,10 @@ language:
36
 
37
  ## 📰 News
38
  - 2026.02.14: We released FireRed-Image-Edit-1.0 model weights. Check more details in the [Model Zoo](#-model-zoo) section.
39
- - 2026.02.10: We released the [Technical Report](https://github.com/FireRedTeam/FireRed-Image-Edit/blob/main/assets/FireRed_Image_Edit_1_0_Techinical_Report.pdf) of FireRed-Image-Edit-1.0.
40
 
41
  ## 🎨 Showcase
42
- Some real outputs produced by FireRed-Image-Edit across genearl editing.
43
  <p align="center">
44
  <img src="./assets/showcase.png" width="800"/>
45
  <p>
@@ -111,9 +116,6 @@ To better validate the capabilities of our model, we propose a benchmark called
111
  ### Inference and Evaluation Code
112
  We provide the inference and evaluation code for REDEdit-Bench. Please refer to the [redbench_infer.py](./src/tools/redbench_infer.py) and [redbench_eval.py](./src/tools/redbench_eval.py) scripts in the `src/tools` directory for more details.
113
 
114
- ### Benchmark Distribution
115
- The REDEdit-Bench dataset will be available soon.
116
-
117
  ### Results on ImgEdit
118
 
119
  <table style="border-collapse:collapse; width:100%; font-family:system-ui, -apple-system, Segoe UI, Roboto, Arial, sans-serif; font-size:14px;">
@@ -275,499 +277,6 @@ The REDEdit-Bench dataset will be available soon.
275
  </tr></tbody>
276
  </table>
277
 
278
- ### Results on GEdit (official public benchmark)
279
-
280
- <div style="overflow-x: auto; margin-bottom: 16px;">
281
- <table style="border-collapse: collapse; width: 100%;">
282
- <thead>
283
- <tr>
284
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Model</th>
285
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">G_SC ↑ (EN)</th>
286
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">G_PQ ↑ (EN)</th>
287
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">G_O ↑ (EN)</th>
288
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">G_SC ↑ (CN)</th>
289
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">G_PQ ↑ (CN)</th>
290
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">G_O ↑ (CN)</th>
291
- </tr>
292
- </thead>
293
- <tbody><tr>
294
- <td colspan="7" style="padding: 8px; border: 1px solid #d0d7de; font-weight: 600; text-align: left;">🔹 Proprietary Models</td>
295
- </tr><tr>
296
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Nano-Banana</td>
297
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.396</td>
298
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.454</strong></td>
299
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.291</td>
300
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.540</td>
301
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.424</strong></td>
302
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.399</td>
303
- </tr><tr>
304
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Seedream4.0</td>
305
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.143</u></td>
306
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.124</td>
307
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.701</td>
308
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.159</u></td>
309
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.074</td>
310
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.692</td>
311
- </tr><tr>
312
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Nano-Banana-Pro</td>
313
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.102</td>
314
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.344</u></td>
315
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>7.738</u></td>
316
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.135</td>
317
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.306</u></td>
318
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>7.799</u></td>
319
- </tr><tr>
320
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Seedream4.5</td>
321
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.268</strong></td>
322
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.167</td>
323
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>7.820</strong></td>
324
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.254</strong></td>
325
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.167</td>
326
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>7.800</strong></td>
327
- </tr><tr>
328
- <td colspan="7" style="padding: 8px; border: 1px solid #d0d7de; font-weight: 600; text-align: left;">🔹 Open-source Models</td>
329
- </tr><tr>
330
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">FLUX.2 [Dev]</td>
331
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.835</td>
332
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.064</td>
333
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.413</td>
334
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.697</td>
335
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.046</td>
336
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.278</td>
337
- </tr><tr>
338
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Qwen-Image-Edit-2509</td>
339
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.974</td>
340
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.714</td>
341
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.480</td>
342
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.988</td>
343
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.679</td>
344
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.467</td>
345
- </tr><tr>
346
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Step1X-Edit-v1.2</td>
347
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.974</td>
348
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.714</td>
349
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.480</td>
350
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.988</td>
351
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.679</td>
352
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.467</td>
353
- </tr><tr>
354
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Longcat-Image-Edit</td>
355
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.128</td>
356
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.177</td>
357
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.748</td>
358
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.141</td>
359
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.117</td>
360
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.731</td>
361
- </tr><tr>
362
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Qwen-Image-Edit-2511</td>
363
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.297</u></td>
364
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.202</u></td>
365
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>7.877</u></td>
366
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.252</u></td>
367
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.134</u></td>
368
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>7.819</u></td>
369
- </tr><tr>
370
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;"><strong>FireRed-Image-Edit</strong></td>
371
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.363</strong></td>
372
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.245</strong></td>
373
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>7.943</strong></td>
374
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.287</strong></td>
375
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.227</strong></td>
376
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>7.887</strong></td>
377
- </tr></tbody>
378
- </table>
379
- </div>
380
-
381
- ### Results on REDEdit-Bench-CN (General Dimensions)
382
-
383
- <div style="overflow-x: auto; margin-bottom: 16px;">
384
- <table style="border-collapse: collapse; width: 100%;">
385
- <thead>
386
- <tr>
387
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Model</th>
388
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Overall</th>
389
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Add</th>
390
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Adjust</th>
391
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">BG</th>
392
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Beauty</th>
393
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Color</th>
394
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Compose</th>
395
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Extract</th>
396
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Portrait</th>
397
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Low-level</th>
398
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Motion</th>
399
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Remove</th>
400
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Replace</th>
401
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Stylize</th>
402
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Text</th>
403
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Viewpoint</th>
404
- </tr>
405
- </thead>
406
- <tbody><tr>
407
- <td colspan="17" style="padding: 8px; border: 1px solid #d0d7de; font-weight: 600; text-align: left;">🔹 Proprietary Models</td>
408
- </tr><tr>
409
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Seedream4.0</td>
410
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.15</td>
411
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.55</td>
412
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.11</td>
413
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.61</u></td>
414
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.83</td>
415
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.14</u></td>
416
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.16</u></td>
417
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.48</td>
418
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.77</td>
419
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.17</u></td>
420
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.68</td>
421
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.02</td>
422
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.53</td>
423
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.94</strong></td>
424
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.94</td>
425
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.29</td>
426
- </tr><tr>
427
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Seedream4.5</td>
428
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.18</u></td>
429
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.58</u></td>
430
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.09</td>
431
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.57</td>
432
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.97</td>
433
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.12</td>
434
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.05</td>
435
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.56</td>
436
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.80</td>
437
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.99</td>
438
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.78</u></td>
439
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.12</u></td>
440
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.53</td>
441
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.94</strong></td>
442
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.07</u></td>
443
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.53</u></td>
444
- </tr><tr>
445
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Nano-Banana</td>
446
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.13</td>
447
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.66</strong></td>
448
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.26</u></td>
449
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.63</strong></td>
450
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.37</strong></td>
451
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.13</td>
452
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.94</td>
453
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.17</u></td>
454
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.83</u></td>
455
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.05</td>
456
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.75</td>
457
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.07</td>
458
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.74</u></td>
459
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.63</td>
460
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.69</td>
461
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.09</td>
462
- </tr><tr>
463
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Nano-Banana-Pro</td>
464
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.48</strong></td>
465
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.66</strong></td>
466
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.41</strong></td>
467
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.58</td>
468
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.35</u></td>
469
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.58</strong></td>
470
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.36</strong></td>
471
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.42</strong></td>
472
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.86</strong></td>
473
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.46</strong></td>
474
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.91</strong></td>
475
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.54</strong></td>
476
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.79</strong></td>
477
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.85</u></td>
478
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.69</strong></td>
479
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.75</strong></td>
480
- </tr><tr>
481
- <td colspan="17" style="padding: 8px; border: 1px solid #d0d7de; font-weight: 600; text-align: left;">🔹 Open-source Models</td>
482
- </tr><tr>
483
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Qwen-Image-Edit-2509</td>
484
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.00</td>
485
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.45</td>
486
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.04</td>
487
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.48</td>
488
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.36</td>
489
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.20</u></td>
490
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.92</td>
491
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.64</td>
492
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.16</td>
493
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.52</td>
494
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.66</td>
495
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.27</td>
496
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.66</td>
497
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.81</td>
498
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.53</td>
499
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.32</td>
500
- </tr><tr>
501
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">FLUX.2 [Dev]</td>
502
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.05</td>
503
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.31</td>
504
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.88</td>
505
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.57</u></td>
506
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.80</strong></td>
507
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.91</td>
508
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.85</td>
509
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.47</td>
510
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.50</strong></td>
511
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.43</u></td>
512
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.68</strong></td>
513
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.50</td>
514
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.47</td>
515
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.95</strong></td>
516
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.53</td>
517
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.88</strong></td>
518
- </tr><tr>
519
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Longcat-Image-Edit</td>
520
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.12</td>
521
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.34</td>
522
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.25</u></td>
523
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.54</td>
524
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.72</u></td>
525
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.12</td>
526
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.92</td>
527
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.48</td>
528
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.49</u></td>
529
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.31</td>
530
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.67</u></td>
531
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.27</td>
532
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.61</td>
533
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.94</u></td>
534
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.83</td>
535
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.30</td>
536
- </tr><tr>
537
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Qwen-Image-Edit-2511</td>
538
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.18</u></td>
539
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.50</u></td>
540
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.23</td>
541
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.52</td>
542
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.61</td>
543
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.09</td>
544
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.00</u></td>
545
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.22</u></td>
546
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.31</td>
547
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.19</td>
548
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.66</td>
549
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.41</u></td>
550
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.68</u></td>
551
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.83</td>
552
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.08</u></td>
553
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.51</u></td>
554
- </tr><tr>
555
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;"><strong>FireRed-Image-Edit</strong></td>
556
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.33</strong></td>
557
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.57</strong></td>
558
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.37</strong></td>
559
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.64</strong></td>
560
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.69</td>
561
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.45</strong></td>
562
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.29</strong></td>
563
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.49</strong></td>
564
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.50</strong></td>
565
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.56</strong></td>
566
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.65</td>
567
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.47</strong></td>
568
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.81</strong></td>
569
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.93</td>
570
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.49</strong></td>
571
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.14</td>
572
- </tr></tbody>
573
- </table>
574
- </div>
575
-
576
- ### Results on REDEdit-Bench-EN (General dimensions)
577
-
578
- <div style="overflow-x: auto; margin-bottom: 16px;">
579
- <table style="border-collapse: collapse; width: 100%;">
580
- <thead>
581
- <tr>
582
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Model</th>
583
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Overall</th>
584
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Add</th>
585
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Adjust</th>
586
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">BG</th>
587
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Beauty</th>
588
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Color</th>
589
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Compose</th>
590
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Extract</th>
591
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Portrait</th>
592
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Low-level</th>
593
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Motion</th>
594
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Remove</th>
595
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Replace</th>
596
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Stylize</th>
597
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Text</th>
598
- <th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Viewpoint</th>
599
- </tr>
600
- </thead>
601
- <tbody><tr>
602
- <td colspan="17" style="padding: 8px; border: 1px solid #d0d7de; font-weight: 600; text-align: left;">🔹 Proprietary Models</td>
603
- </tr><tr>
604
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Nano-Banana</td>
605
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.15</td>
606
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.65</td>
607
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.23</u></td>
608
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.60</td>
609
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.37</strong></td>
610
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.08</td>
611
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.98</td>
612
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.39</strong></td>
613
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.72</td>
614
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.03</td>
615
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.63</td>
616
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.07</td>
617
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.68</u></td>
618
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.68</td>
619
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.87</td>
620
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.23</td>
621
- </tr><tr>
622
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Seedream4.0</td>
623
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.18</td>
624
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.59</td>
625
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.12</td>
626
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.63</u></td>
627
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.89</td>
628
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.10</u></td>
629
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.14</u></td>
630
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.28</td>
631
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.77</u></td>
632
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.12</td>
633
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.73</td>
634
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.23</td>
635
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.56</td>
636
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.98</strong></td>
637
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.21</u></td>
638
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.42</td>
639
- </tr><tr>
640
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Seedream4.5</td>
641
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.20</u></td>
642
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.66</u></td>
643
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.08</td>
644
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.64</strong></td>
645
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.12</u></td>
646
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.07</td>
647
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.10</td>
648
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.23</td>
649
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.74</td>
650
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.28</u></td>
651
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.75</u></td>
652
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.24</u></td>
653
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.58</td>
654
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.97</u></td>
655
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.20</td>
656
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.44</u></td>
657
- </tr><tr>
658
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Nano-Banana-Pro</td>
659
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.42</strong></td>
660
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.72</strong></td>
661
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.40</strong></td>
662
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.64</strong></td>
663
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.37</strong></td>
664
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.43</strong></td>
665
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.32</strong></td>
666
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.25</u></td>
667
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.82</strong></td>
668
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.36</strong></td>
669
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.85</strong></td>
670
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.52</strong></td>
671
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.75</strong></td>
672
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.90</td>
673
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.54</strong></td>
674
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.51</strong></td>
675
- </tr><tr>
676
- <td colspan="17" style="padding: 8px; border: 1px solid #d0d7de; font-weight: 600; text-align: left;">🔹 Open-source Models</td>
677
- </tr><tr>
678
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Qwen-Image-Edit-2509</td>
679
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.99</td>
680
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.47</u></td>
681
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.06</td>
682
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.49</td>
683
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.13</td>
684
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.98</td>
685
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.85</td>
686
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.91</td>
687
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.30</td>
688
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.71</td>
689
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.58</td>
690
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.40</td>
691
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.67</u></td>
692
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.77</td>
693
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.77</td>
694
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.85</td>
695
- </tr><tr>
696
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">FLUX.2 [Dev]</td>
697
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.07</td>
698
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.37</td>
699
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.96</td>
700
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.47</td>
701
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.72</u></td>
702
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.86</td>
703
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.87</td>
704
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.36</td>
705
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.44</td>
706
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.45</u></td>
707
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.67</td>
708
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.02</td>
709
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.48</td>
710
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.87</u></td>
711
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.80</td>
712
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.84</strong></td>
713
- </tr><tr>
714
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">LongCat-Image-Edit</td>
715
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.12</td>
716
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.38</td>
717
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.04</td>
718
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.49</td>
719
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.89</strong></td>
720
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.10</u></td>
721
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.93</td>
722
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.98</td>
723
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.47</u></td>
724
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.27</td>
725
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.69</u></td>
726
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.24</td>
727
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.51</td>
728
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.86</td>
729
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.83</td>
730
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.25</td>
731
- </tr><tr>
732
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Qwen-Image-Edit-2511</td>
733
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.23</u></td>
734
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.55</strong></td>
735
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.17</u></td>
736
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.56</u></td>
737
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.49</td>
738
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.07</td>
739
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.07</u></td>
740
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.54</strong></td>
741
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.42</td>
742
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.52</strong></td>
743
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.72</strong></td>
744
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.42</u></td>
745
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.65</td>
746
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.85</td>
747
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.06</u></td>
748
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.38</u></td>
749
- </tr><tr>
750
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;"><strong>FireRed-Image-Edit</strong></td>
751
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.26</strong></td>
752
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.41</td>
753
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.33</strong></td>
754
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.60</strong></td>
755
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.55</td>
756
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.47</strong></td>
757
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.25</strong></td>
758
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.49</u></td>
759
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.50</strong></td>
760
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.44</td>
761
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.65</td>
762
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.46</strong></td>
763
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.70</strong></td>
764
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.94</strong></td>
765
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.44</strong></td>
766
- <td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.78</td>
767
- </tr></tbody>
768
- </table>
769
- </div>
770
-
771
  ## 📜 License Agreement
772
 
773
  The code and the weights of FireRed-Image-Edit are licensed under Apache 2.0.
@@ -791,21 +300,13 @@ We kindly encourage citation of our work if you find it useful.
791
  year={2026},
792
  archivePrefix={arXiv},
793
  primaryClass={cs.CV},
794
- url={https://arxiv.org/abs/xxxx.xxxxx},
795
  }
796
  ```
797
 
798
- ## ⚠️ Ethics Statement
799
- FireRed-Image-Edit has not been specifically designed or comprehensively evaluated for every possible downstream application. Users should be aware of the potential risks and ethical considerations when using this project, and should use it responsibly and in compliance with all applicable laws and regulations.
800
-
801
- - **Prohibited Use**: This project must not be used to generate content that is illegal, defamatory, pornographic, harmful, or that violates the privacy, rights, or interests of individuals or organizations.
802
- - **User Responsibility**: Users are solely responsible for any content generated using this project. The authors and contributors assume no responsibility or liability for any misuse of the codebase or for any consequences resulting from its use.
803
-
804
-
805
-
806
  ## 🤝 Acknowledgements
807
 
808
- We would like to thank the developers of the amazing open-source projects, including [Qwen-Image](https://github.com/QwenLM/Qwen-Image), [Diffusers](https://github.com/huggingface/diffusers) and [HuggingFace](https://huggingface.co)
809
 
810
  ## ⭐ Star History
811
 
 
1
  ---
 
2
  language:
3
  - en
4
  - zh
5
+ license: apache-2.0
6
+ pipeline_tag: image-to-image
7
+ library_name: diffusers
8
+ arxiv: 2602.13344
9
  ---
10
+
11
  <p align="center">
12
  <img src="./assets/logo.png" width="600"/>
13
  <p>
 
20
  <p align="center" style="line-height: 1;">
21
  🤗 <a href="https://huggingface.co/FireRedTeam/FireRed-Image-Edit-1.0">HuggingFace</a> |
22
  🖥️ <a href="https://huggingface.co/spaces/FireRedTeam/FireRed-Image-Edit-1.0"> Demo</a> |
23
+ 📄 <a href="https://huggingface.co/papers/2602.13344">Technical Report</a> |
24
+ 💻 <a href="https://github.com/FireRedTeam/FireRed-Image-Edit">Code</a>
25
  </p>
26
  <p align="center">
27
  <img src="./assets/teaser.png" width="800"/>
 
29
 
30
 
31
  ## 🔥 FireRed-Image-Edit
32
+ **FireRed-Image-Edit** is a general-purpose image editing model that delivers high-fidelity and consistent editing across a wide range of scenarios. It is introduced in the paper [FireRed-Image-Edit-1.0 Technical Report](https://huggingface.co/papers/2602.13344).
33
 
34
  ## ✨ Key Features
35
  - **Strong Editing Performance**: FireRed-Image-Edit delivers leading open-source results with accurate instruction following, high image quality, and consistent visual coherence.
 
41
 
42
  ## 📰 News
43
  - 2026.02.14: We released FireRed-Image-Edit-1.0 model weights. Check more details in the [Model Zoo](#-model-zoo) section.
44
+ - 2026.02.10: We released the [Technical Report](https://huggingface.co/papers/2602.13344) of FireRed-Image-Edit-1.0.
45
 
46
  ## 🎨 Showcase
47
+ Some real outputs produced by FireRed-Image-Edit across general editing.
48
  <p align="center">
49
  <img src="./assets/showcase.png" width="800"/>
50
  <p>
 
116
  ### Inference and Evaluation Code
117
  We provide the inference and evaluation code for REDEdit-Bench. Please refer to the [redbench_infer.py](./src/tools/redbench_infer.py) and [redbench_eval.py](./src/tools/redbench_eval.py) scripts in the `src/tools` directory for more details.
118
 
 
 
 
119
  ### Results on ImgEdit
120
 
121
  <table style="border-collapse:collapse; width:100%; font-family:system-ui, -apple-system, Segoe UI, Roboto, Arial, sans-serif; font-size:14px;">
 
277
  </tr></tbody>
278
  </table>
279
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
280
  ## 📜 License Agreement
281
 
282
  The code and the weights of FireRed-Image-Edit are licensed under Apache 2.0.
 
300
  year={2026},
301
  archivePrefix={arXiv},
302
  primaryClass={cs.CV},
303
+ url={https://huggingface.co/papers/2602.13344},
304
  }
305
  ```
306
 
 
 
 
 
 
 
 
 
307
  ## 🤝 Acknowledgements
308
 
309
+ We would like to thank the developers of the amazing open-source projects, including [Qwen-Image](https://github.com/QwenLM/Qwen-Image), [Diffusers](https://github.com/huggingface/diffusers) and [HuggingFace](https://huggingface.co).
310
 
311
  ## ⭐ Star History
312