Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -166,7 +166,7 @@ __100 input/300 output; tok/s:__
|
|
| 166 |
|
| 167 |
| GPU/Model | S | M | L | XL | Original | W8A8, int8 |
|
| 168 |
|-----------|-----|---|---|----|----------|------------|
|
| 169 |
-
| H100 |
|
| 170 |
| L40S | 46 | 40 | 38 | -1 | 27 | 50 | - |
|
| 171 |
|
| 172 |
|
|
|
|
| 166 |
|
| 167 |
| GPU/Model | S | M | L | XL | Original | W8A8, int8 |
|
| 168 |
|-----------|-----|---|---|----|----------|------------|
|
| 169 |
+
| H100 | 133 | 120 | 115 | 90 | 39 | 142 | - |
|
| 170 |
| L40S | 46 | 40 | 38 | -1 | 27 | 50 | - |
|
| 171 |
|
| 172 |
|