Update README.md
Browse files
README.md
CHANGED
|
@@ -162,11 +162,13 @@ In order to make a continuous score that can be used for reranking query-context
|
|
| 162 |
|
| 163 |
We include scripts to do this in vLLM, LMDeploy, and OpenAI (hosted for free on Huggingface):
|
| 164 |
|
| 165 |
-
|
|
|
|
|
|
|
| 166 |
|
| 167 |
Install [vLLM](https://github.com/vllm-project/vllm/) using `pip install vllm`.
|
| 168 |
|
| 169 |
-
<details>
|
| 170 |
<summary>Show vLLM code</summary>
|
| 171 |
|
| 172 |
```python
|
|
@@ -211,12 +213,8 @@ print(expected_vals)
|
|
| 211 |
# [6.66570732 1.86686378 1.01102923]
|
| 212 |
```
|
| 213 |
|
| 214 |
-
</details>
|
| 215 |
-
|
| 216 |
-
|
| 217 |
-
|
| 218 |
-
|
| 219 |
-
### LMDeploy
|
| 220 |
|
| 221 |
Install [LMDeploy](https://github.com/InternLM/lmdeploy) using `pip install lmdeploy`.
|
| 222 |
|
|
@@ -277,10 +275,8 @@ print(expected_vals)
|
|
| 277 |
# [6.66415229 1.84342025 1.01133205]
|
| 278 |
```
|
| 279 |
|
| 280 |
-
</details>
|
| 281 |
-
|
| 282 |
-
|
| 283 |
-
### OpenAI (Hosted on Huggingface)
|
| 284 |
|
| 285 |
Install [openai](https://github.com/openai/openai-python) using `pip install openai`.
|
| 286 |
|
|
@@ -342,9 +338,8 @@ print(expected_vals)
|
|
| 342 |
# [6.64866580, 1.85144404, 1.010719508]
|
| 343 |
```
|
| 344 |
|
| 345 |
-
</details>
|
| 346 |
-
|
| 347 |
-
<br/>
|
| 348 |
|
| 349 |
# Evaluation
|
| 350 |
|
|
|
|
| 162 |
|
| 163 |
We include scripts to do this in vLLM, LMDeploy, and OpenAI (hosted for free on Huggingface):
|
| 164 |
|
| 165 |
+
|
| 166 |
+
<ul>
|
| 167 |
+
<li><b>vLLM</b>
|
| 168 |
|
| 169 |
Install [vLLM](https://github.com/vllm-project/vllm/) using `pip install vllm`.
|
| 170 |
|
| 171 |
+
<details open>
|
| 172 |
<summary>Show vLLM code</summary>
|
| 173 |
|
| 174 |
```python
|
|
|
|
| 213 |
# [6.66570732 1.86686378 1.01102923]
|
| 214 |
```
|
| 215 |
|
| 216 |
+
</details></li>
|
| 217 |
+
<li><b>LMDeploy</b>
|
|
|
|
|
|
|
|
|
|
|
|
|
| 218 |
|
| 219 |
Install [LMDeploy](https://github.com/InternLM/lmdeploy) using `pip install lmdeploy`.
|
| 220 |
|
|
|
|
| 275 |
# [6.66415229 1.84342025 1.01133205]
|
| 276 |
```
|
| 277 |
|
| 278 |
+
</details></li>
|
| 279 |
+
<li><b>OpenAI (Hosted on Huggingface)</b>
|
|
|
|
|
|
|
| 280 |
|
| 281 |
Install [openai](https://github.com/openai/openai-python) using `pip install openai`.
|
| 282 |
|
|
|
|
| 338 |
# [6.64866580, 1.85144404, 1.010719508]
|
| 339 |
```
|
| 340 |
|
| 341 |
+
</details></li>
|
| 342 |
+
</ul>
|
|
|
|
| 343 |
|
| 344 |
# Evaluation
|
| 345 |
|