Update README.md

README.md

@@ -132,34 +132,13 @@ Core model results for OLMo 2 1B are found below.
 | GPT-3.5 Turbo 0125     | 60.5 | n/a       | 38.7 | 66.6 | 70.2 | 74.3  | 66.9 | 41.2 | 70.2 | 69.1   | 45.0 | 62.9 |
 | GPT 4o Mini 0724       | 65.7 | n/a       | 49.7 | 65.9 | 36.3 | 83.0  | 83.5 | 67.9 | 82.2 | 84.9   | 39.0 | 64.8 |
 | **Open weights models 1-1.7B Parameters** |      |           |      |      |      |       |      |      |      |        |      |      |
-| SmolLM2 1.7B           | 34.2 | TODO      | 5.8  | 39.8 | 30.9 | 45.3  | 51.6 | 20.3 | 34.3 | 52.4   | 16.4 | 45.3 |
-| Gemma 3 1B             | 38.3 | TODO      | 20.4 | 39.4 | 25.1 | 35.0  | 60.6 | 40.3 | 38.9 | 70.2   | 9.6  | 43.8 |
-| Llama 3.1 1B           | 39.3 | TODO      | 10.1 | 40.2 | 32.2 | 45.4  | 54.0 | 21.6 | 46.7 | 87.2   | 13.8 | 41.5 |
-| Qwen 2.5 1.5B          | 41.7 | TODO      | 7.4  | 45.8 | 13.4 | 66.2  | 44.2 | 40.6 | 59.7 | 77.6   | 15.5 | 46.5 |
-| **Open weights models 7-14B Parameters** |      |           |      |      |      |       |      |      |      |        |      |      |
-| Ministral 8B 2410      | 53.5 | n/a       | 31.4 | 70.8 | 56.2 | 80.0  | 56.4 | 40.0 | 68.5 | 56.2   | 20.2 | 55.5 |
-| Llama 3.1 8B           | 59.1 | 7.2       | 25.8 | 71.9 | 61.7 | 83.4  | 80.6 | 42.5 | 71.3 | 70.2   | 28.4 | 55.1 |
-| Tulu 3 8B              | 60.7 | 7.2       | 34.0 | 69.0 | 62.6 | 87.6  | 82.4 | 43.7 | 68.2 | 75.4   | 29.1 | 55.0 |
-| Qwen 2.5 7B            | 61.6 | 8.2       | 29.7 | 70.2 | 54.4 | 83.8  | 74.7 | 69.9 | 76.6 | 75.0   | 18.1 | 63.1 |
-| Gemma 2 9B             | 58.1 | 4.4       | 43.7 | 64.9 | 58.8 | 79.7  | 69.9 | 29.8 | 69.1 | 75.5   | 28.3 | 61.4 |
-| Qwen 2.5 14B           | 65.3 | 16.0      | 34.6 | 78.4 | 50.5 | 83.9  | 82.4 | 70.6 | 81.1 | 79.3   | 21.1 | 70.8 |
-| **Open weights models 24-32B Parameters** |      |           |      |      |      |       |      |      |      |        |      |      |
-| Gemma 2 27B            | 61.3 | 21.0      | 49.0 | 72.7 | 67.5 | 80.7  | 63.2 | 35.1 | 70.7 | 75.9   | 33.9 | 64.6 |
-| Qwen 2.5 32B           | 68.1 | 35.0      | 39.1 | 82.3 | 48.3 | 87.5  | 82.4 | 77.9 | 84.7 | 82.4   | 26.1 | 70.6 |
-| Mistral Small 24B      | 67.5 | n/a       | 43.2 | 80.1 | 78.5 | 87.2  | 77.3 | 65.9 | 83.7 | 66.5   | 24.4 | 68.1 |
-| Qwen QwQ 32B           | -    | 35.0      | 82.4 | 89.6 | 54.7 | 95.5  | 85.8 | 98.1 | 88.4 | 69.9   | -    | -    |
-| Gemma 3 27B            | 71.3 | 23.0      | 63.4 | 83.7 | 69.2 | 91.1  | 83.4 | 76.2 | 81.8 | 69.1   | 30.9 | 63.9 |
-| **Open weights models ~70B Parameters** |      |           |      |      |      |       |      |      |      |        |      |      |
-| Qwen 2.5 72B           | 68.8 | 79.0      | 47.7 | 80.4 | 34.2 | 89.5  | 87.6 | 75.9 | 85.5 | 87.0   | 30.6 | 69.9 |
-| Llama 3.1 70B          | 70.7 | 64.0      | 32.9 | 83.0 | 77.0 | 94.5  | 88.0 | 56.2 | 85.2 | 76.4   | 46.5 | 66.8 |
-| Llama 3.3 70B          | 72.7 | 64.0      | 36.5 | 85.8 | 78.0 | 93.6  | 90.8 | 71.8 | 85.9 | 70.4   | 48.2 | 66.1 |
+| SmolLM2 1.7B           | 34.2 | 1.1      | 5.8  | 39.8 | 30.9 | 45.3  | 51.6 | 20.3 | 34.3 | 52.4   | 16.4 | 45.3 |
+| Gemma 3 1B             | 38.3 | 1.2      | 20.4 | 39.4 | 25.1 | 35.0  | 60.6 | 40.3 | 38.9 | 70.2   | 9.6  | 43.8 |
+| Llama 3.1 1B           | 39.3 | 6.7      | 10.1 | 40.2 | 32.2 | 45.4  | 54.0 | 21.6 | 46.7 | 87.2   | 13.8 | 41.5 |
+| Qwen 2.5 1.5B          | 41.7 | 1.7      | 7.4  | 45.8 | 13.4 | 66.2  | 44.2 | 40.6 | 59.7 | 77.6   | 15.5 | 46.5 |
 | **Fully-open models**  |      |           |      |      |      |       |      |      |      |        |      |      |
-| OLMo 1B 0724           | 24.4 |       | 2.4  | 29.9 | 27.9 | 10.8  | 25.3 | 2.2  | 36.6 | 52.0   | 12.1 | 44.3 |
-| OLMo 7B 0424           | 33.1 | 1.0       | 8.5  | 34.4 | 47.9 | 23.2  | 39.2 | 5.2  | 48.9 | 49.3   | 18.9 | 55.2 |
+| OLMo 1B 0724           | 24.4 |   0.22    | 2.4  | 29.9 | 27.9 | 10.8  | 25.3 | 2.2  | 36.6 | 52.0   | 12.1 | 44.3 |
 | **OLMo 2 1B**              | 42.7 | 0.35      | 9.1  | 35.0 | 34.6 | 68.3  | 70.1 | 20.7 | 40.0 | 87.6   | 12.9 | 48.7 |
-| OLMo 2 7B              | 56.5 | 1.8       | 29.1 | 51.4 | 60.5 | 85.1  | 72.3 | 32.5 | 61.3 | 93.3   | 23.2 | 56.5 |
-| OLMo 2 13B             | 63.5 | 4.6       | 39.5 | 63.0 | 71.5 | 87.4  | 82.6 | 39.2 | 68.5 | 89.7   | 28.8 | 64.3 |
-| OLMo 2 32B             | 68.8 | 13.0      | 42.8 | 70.6 | 78.0 | 87.6  | 85.6 | 49.7 | 77.3 | 85.9   | 37.5 | 73.2 |
 
 
 ## Model Details