Update README.md
Browse files
README.md
CHANGED
|
@@ -134,10 +134,10 @@ Benchmarking is one of the most important procedures during model acceleration.
|
|
| 134 |
|
| 135 |
| Metric/Model | S | M | L | XL | Original | W8A8, int8 |
|
| 136 |
|---------------|---|---|---|----|----------|------------|
|
| 137 |
-
| arc_challenge | 38.70 | 40.40 | 40.40 | 40.50 | 40.50 |
|
| 138 |
-
| mmlu | 52.70 | 54.70 | 55.50 | 54.80 | 54.80 |
|
| 139 |
-
| piqa | 76.30 | 75.90 | 75.70 | 76.10 | 76.10 |
|
| 140 |
-
| winogrande | 66.60 | 66.20 | 67.80 | 68.00 | 68.00 |
|
| 141 |
|
| 142 |
|
| 143 |
|
|
|
|
| 134 |
|
| 135 |
| Metric/Model | S | M | L | XL | Original | W8A8, int8 |
|
| 136 |
|---------------|---|---|---|----|----------|------------|
|
| 137 |
+
| arc_challenge | 38.70 | 40.40 | 40.40 | 40.50 | 40.50 | 19.30 | - |
|
| 138 |
+
| mmlu | 52.70 | 54.70 | 55.50 | 54.80 | 54.80 | 47.70 | - |
|
| 139 |
+
| piqa | 76.30 | 75.90 | 75.70 | 76.10 | 76.10 | 55.00 | - |
|
| 140 |
+
| winogrande | 66.60 | 66.20 | 67.80 | 68.00 | 68.00 | 56.10 | - |
|
| 141 |
|
| 142 |
|
| 143 |
|