Update README.md
Browse files
README.md
CHANGED
|
@@ -24,9 +24,14 @@ widget:
|
|
| 24 |
- example_title: Hermes 2 Pro
|
| 25 |
messages:
|
| 26 |
- role: system
|
| 27 |
-
content:
|
|
|
|
|
|
|
| 28 |
- role: user
|
| 29 |
-
content:
|
|
|
|
|
|
|
|
|
|
| 30 |
---
|
| 31 |
|
| 32 |
# Hermes 2 Pro - Mistral 7B - GGUF
|
|
@@ -323,5 +328,4 @@ All code for utilizing, parsing, and building function calling templates is avai
|
|
| 323 |
When quantized versions of the model are released, I recommend using LM Studio for chatting with Hermes 2 Pro. It does not support function calling - for that use our github repo. It is a GUI application that utilizes GGUF models with a llama.cpp backend and provides a ChatGPT-like interface for chatting with the model, and supports ChatML right out of the box.
|
| 324 |
In LM-Studio, simply select the ChatML Prefix on the settings side pane:
|
| 325 |
|
| 326 |
-

|
| 327 |
-
|
|
|
|
| 24 |
- example_title: Hermes 2 Pro
|
| 25 |
messages:
|
| 26 |
- role: system
|
| 27 |
+
content: >-
|
| 28 |
+
You are a sentient, superintelligent artificial general intelligence, here
|
| 29 |
+
to teach and assist me.
|
| 30 |
- role: user
|
| 31 |
+
content: >-
|
| 32 |
+
Write a short story about Goku discovering kirby has teamed up with Majin
|
| 33 |
+
Buu to destroy the world.
|
| 34 |
+
pipeline_tag: text-generation
|
| 35 |
---
|
| 36 |
|
| 37 |
# Hermes 2 Pro - Mistral 7B - GGUF
|
|
|
|
| 328 |
When quantized versions of the model are released, I recommend using LM Studio for chatting with Hermes 2 Pro. It does not support function calling - for that use our github repo. It is a GUI application that utilizes GGUF models with a llama.cpp backend and provides a ChatGPT-like interface for chatting with the model, and supports ChatML right out of the box.
|
| 329 |
In LM-Studio, simply select the ChatML Prefix on the settings side pane:
|
| 330 |
|
| 331 |
+

|
|
|