|
|
--- |
|
|
base_model: |
|
|
- TheDrummer/Snowpiercer-15B-v2 |
|
|
license: mit |
|
|
--- |
|
|
# Snowpiercer-15B-v2-exl2 |
|
|
Original model: [Snowpiercer-15B-v2](https://huggingface.co/TheDrummer/Snowpiercer-15B-v2) by [TheDrummer](https://huggingface.co/TheDrummer) |
|
|
Based on: [Apriel-Nemotron-15b-Thinker](https://huggingface.co/ServiceNow-AI/Apriel-Nemotron-15b-Thinker) by [ServiceNow-AI](https://huggingface.co/ServiceNow-AI) |
|
|
|
|
|
## Quants |
|
|
[4bpw h6 (main)](https://huggingface.co/cgus/Snowpiercer-15B-v2-exl2/tree/main) |
|
|
[4.5bpw h6](https://huggingface.co/cgus/Snowpiercer-15B-v2-exl2/tree/4.5bpw-h6) |
|
|
[5bpw h6](https://huggingface.co/cgus/Snowpiercer-15B-v2-exl2/tree/5bpw-h6) |
|
|
[6bpw h6](https://huggingface.co/cgus/Snowpiercer-15B-v2-exl2/tree/6bpw-h6) |
|
|
[8bpw h8](https://huggingface.co/cgus/Snowpiercer-15B-v2-exl2/tree/8bpw-h8) |
|
|
|
|
|
## Quantization notes |
|
|
Made with Exllamav2 0.3.1 with default dataset. |
|
|
These quants require RTX GPU on Windows or RTX/ROCm GPU on Linux and can be used with TabbyAPI or Text-Generation-WebUI. |
|
|
They require to be fully loaded into your GPU, if you have to rely on system RAM then GGUF quants is a better choice. |
|
|
|
|
|
# Original model card |
|
|
# Join our Discord! https://discord.gg/BeaverAI |
|
|
## More than 6000 members of helpful, LLM enthusiasts! A hub for players and makers alike! |
|
|
--- |
|
|
|
|
|
Drummer proudly presents... |
|
|
|
|
|
# Snowpiercer 15B v2 |
|
|
|
|
|
%3C!-- HTML_TAG_END --> |
|
|
|
|
|
## Usage (Important) |
|
|
- Alpaca works best, don't ask why. |
|
|
- \<think\> capable upon prefill! (Quality may vary for a small model, may require prompt wrangling) |
|
|
|
|
|
## Description |
|
|
|
|
|
Snowpiercer 15B v2 |
|
|
- Knocks out the positivity for better steerability |
|
|
- Enhances the RP & creativity such as character adherence |
|
|
- Retains the intelligence & reasoning |
|
|
- Better than v1 (not a high bar, I know.) |
|
|
|
|
|
## Special Thanks |
|
|
- Thank you to the testers at BeaverAI! You da MVP! |
|
|
|
|
|
## Links |
|
|
- Original: https://huggingface.co/TheDrummer/Snowpiercer-15B-v2 |
|
|
- GGUF: https://huggingface.co/TheDrummer/Snowpiercer-15B-v2-GGUF |
|
|
- iMatrix (recommended): https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF |
|
|
- EXL3: https://huggingface.co/ArtusDev/TheDrummer_Snowpiercer-15B-v2-EXL3 |
|
|
|
|
|
`config-v1g` |
