psynote123 commited on
Commit
3fdf492
·
verified ·
1 Parent(s): c2c953b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -14
README.md CHANGED
@@ -13,10 +13,6 @@ Elastic models are the models produced by TheStage AI ANNA: Automated Neural Net
13
 
14
  * __XL__: Mathematically equivalent neural network, optimized with our DNN compiler.
15
 
16
- * __L__: Near lossless model, with less than 1% degradation obtained on corresponding benchmarks.
17
-
18
- * __M__: Faster model, with accuracy degradation less than 1.5%.
19
-
20
  * __S__: The fastest model, with accuracy degradation less than 2%.
21
 
22
 
@@ -101,20 +97,19 @@ Benchmarking is one of the most important procedures during model acceleration.
101
 
102
  ### Quality benchmarks
103
 
104
- For quality evaluation we have used: PSNR, SSIM and CLIP score. PSNR and SSIM were computed using outputs of original model.
105
- | Metric/Model | S | M | L | XL | Original |
106
- |---------------|---|---|---|----|----------|
107
- | PSNR | TBD | TBD | TBD | inf | inf |
108
- | SSIM | TBD | TBD | TBD | 1.0 | 1.0 |
109
- | CLIP | TBD | TBD | TBD | TBD | TBD|
110
 
111
 
112
  ### Latency benchmarks
113
 
114
  Time in seconds to generate one image 1024x1024
115
- | GPU/Model | S | M | L | XL | Original |
116
- |-----------|-----|---|---|----|----------|
117
- | H100 | TBD | TBD | TBD | 3.80 | 6.55 |
118
 
119
 
120
  ## Links
@@ -122,4 +117,4 @@ Time in seconds to generate one image 1024x1024
122
  * __Platform__: [app.thestage.ai](https://app.thestage.ai)
123
  <!-- * __Elastic models Github__: [app.thestage.ai](app.thestage.ai) -->
124
  * __Subscribe for updates__: [TheStageAI X](https://x.com/TheStageAI)
125
- * __Contact email__: contact@thestage.ai
 
13
 
14
  * __XL__: Mathematically equivalent neural network, optimized with our DNN compiler.
15
 
 
 
 
 
16
  * __S__: The fastest model, with accuracy degradation less than 2%.
17
 
18
 
 
97
 
98
  ### Quality benchmarks
99
 
100
+ For quality evaluation we have used: PSNR and SSIM. PSNR and SSIM were computed using outputs of original model.
101
+ | Metric/Model | S | XL | Original |
102
+ |---------------|---|----|----------|
103
+ | PSNR | 20.78 | 29.13 | inf |
104
+ | SSIM | 0.81 | 0.95 | 1.0 |
 
105
 
106
 
107
  ### Latency benchmarks
108
 
109
  Time in seconds to generate one image 1024x1024
110
+ | GPU/Model | S | XL | Original |
111
+ |-----------|-----|----|----------|
112
+ | H100 | 3.10 | 3.80 | 6.55 |
113
 
114
 
115
  ## Links
 
117
  * __Platform__: [app.thestage.ai](https://app.thestage.ai)
118
  <!-- * __Elastic models Github__: [app.thestage.ai](app.thestage.ai) -->
119
  * __Subscribe for updates__: [TheStageAI X](https://x.com/TheStageAI)
120
+ * __Contact email__: contact@thestage.ai