Sam Heutmaker
commited on
Commit
·
0d7a0bc
1
Parent(s):
0efb203
update readme
Browse files
README.md
CHANGED
|
@@ -87,18 +87,8 @@ Performance metrics on our internal evaluation set:
|
|
| 87 |
| claude_4_sonnet | 3.16 | 0.463 | 0.179 | 0.281 | 0.060 |
|
| 88 |
| gpt_4.1 | 3.64 | 0.581 | 0.260 | 0.376 | 0.119 |
|
| 89 |
|
| 90 |
-
|
| 91 |
-
|
| 92 |
-
<table>
|
| 93 |
-
<tr>
|
| 94 |
-
<td><img src="./assets/judge-score.png" alt="Average Judge Score Comparison" width="100%" /></td>
|
| 95 |
-
<td><img src="./assets/rouge-1.png" alt="ROUGE-1 Score Comparison" width="100%" /></td>
|
| 96 |
-
</tr>
|
| 97 |
-
<tr>
|
| 98 |
-
<td><img src="./assets/rouge-L.png" alt="ROUGE-L Score Comparison" width="100%" /></td>
|
| 99 |
-
<td><img src="./assets/bleu.png" alt="BLEU Score Comparison" width="100%" /></td>
|
| 100 |
-
</tr>
|
| 101 |
-
</table>
|
| 102 |
|
| 103 |
FP8 quantization showed no measurable quality degradation compared to bf16 precision.
|
| 104 |
|
|
|
|
| 87 |
| claude_4_sonnet | 3.16 | 0.463 | 0.179 | 0.281 | 0.060 |
|
| 88 |
| gpt_4.1 | 3.64 | 0.581 | 0.260 | 0.376 | 0.119 |
|
| 89 |
|
| 90 |
+
<img src="./assets/judge-score.png" alt="Average Judge Score Comparison" width="100%" />
|
| 91 |
+
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 92 |
|
| 93 |
FP8 quantization showed no measurable quality degradation compared to bf16 precision.
|
| 94 |
|