Update usage instructions with infinity / Sentence Transformers
Browse files
README.md
CHANGED
|
@@ -2107,6 +2107,14 @@ scores = (query_embeddings @ passage_embeddings.T) * 100
|
|
| 2107 |
print(scores.tolist())
|
| 2108 |
```
|
| 2109 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2110 |
## License
|
| 2111 |
This model should not be used for any commercial purpose. Refer the [license](https://spdx.org/licenses/CC-BY-NC-4.0) for the detailed terms.
|
| 2112 |
|
|
|
|
| 2107 |
print(scores.tolist())
|
| 2108 |
```
|
| 2109 |
|
| 2110 |
+
### Usage (Infinity)
|
| 2111 |
+
|
| 2112 |
+
Usage via [Infinity, MIT License](https://github.com/michaelfeil/infinity).
|
| 2113 |
+
```bash
|
| 2114 |
+
docker run -it --gpus all -v ./data:/app/.cache -p 7997:7997 michaelf34/infinity:0.0.70 \
|
| 2115 |
+
v2 --model-id nvidia/NV-Embed-v2 --revision "refs/pr/23" --batch-size 8
|
| 2116 |
+
```
|
| 2117 |
+
|
| 2118 |
## License
|
| 2119 |
This model should not be used for any commercial purpose. Refer the [license](https://spdx.org/licenses/CC-BY-NC-4.0) for the detailed terms.
|
| 2120 |
|