quazim commited on
Commit
5923ffe
·
verified ·
1 Parent(s): 2d22ff2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -134,10 +134,10 @@ Benchmarking is one of the most important procedures during model acceleration.
134
 
135
  | Metric/Model | S | M | L | XL | Original | W8A8, int8 |
136
  |---------------|---|---|---|----|----------|------------|
137
- | arc_challenge | 38.70 | 40.40 | 40.40 | 40.50 | 40.50 | 39.30 | - |
138
- | mmlu | 52.70 | 54.70 | 55.50 | 54.80 | 54.80 | 52.70 | - |
139
- | piqa | 76.30 | 75.90 | 75.70 | 76.10 | 76.10 | 75.00 | - |
140
- | winogrande | 66.60 | 66.20 | 67.80 | 68.00 | 68.00 | 66.10 | - |
141
 
142
 
143
 
 
134
 
135
  | Metric/Model | S | M | L | XL | Original | W8A8, int8 |
136
  |---------------|---|---|---|----|----------|------------|
137
+ | arc_challenge | 38.70 | 40.40 | 40.40 | 40.50 | 40.50 | 19.30 | - |
138
+ | mmlu | 52.70 | 54.70 | 55.50 | 54.80 | 54.80 | 47.70 | - |
139
+ | piqa | 76.30 | 75.90 | 75.70 | 76.10 | 76.10 | 55.00 | - |
140
+ | winogrande | 66.60 | 66.20 | 67.80 | 68.00 | 68.00 | 56.10 | - |
141
 
142
 
143