metadata
base_model: Locutusque/gpt2-xl-conversational
datasets:
- Locutusque/InstructMix
language:
- en
license: mit
metrics:
- bleu
- perplexity
- loss
- accuracy
pipeline_tag: text-generation
tags:
- llama-cpp
- matrixportal
widget:
- text: >-
<|USER|> Design a Neo4j database and Cypher function snippet to Display
Extreme Dental hygiene: Using Mouthwash for Analysis for Beginners.
Implement if/else or switch/case statements to handle different conditions
related to the Consent. Provide detailed comments explaining your control
flow and the reasoning behind each decision. <|ASSISTANT|>
- text: '<|USER|> Write me a story about a magical place. <|ASSISTANT|> '
- text: >-
<|USER|> Write me an essay about the life of George Washington
<|ASSISTANT|>
- text: '<|USER|> Solve the following equation 2x + 10 = 20 <|ASSISTANT|> '
- text: >-
<|USER|> Craft me a list of some nice places to visit around the world.
<|ASSISTANT|>
- text: >-
<|USER|> How to manage a lazy employee: Address the employee verbally.
Don't allow an employee's laziness or lack of enthusiasm to become a
recurring issue. Tell the employee you're hoping to speak with them about
workplace expectations and performance, and schedule a time to sit down
together. Question: To manage a lazy employee, it is suggested to talk to
the employee. True, False, or Neither? <|ASSISTANT|>
inference:
parameters:
temperature: 0.8
do_sample: true
top_p: 0.14
top_k: 41
max_new_tokens: 250
repetition_penalty: 1.176
ysn-rfd/gpt2-xl-conversational-GGUF
This model was converted to GGUF format from Locutusque/gpt2-xl-conversational using llama.cpp via the ggml.ai's all-gguf-same-where space.
Refer to the original model card for more details on the model.
✅ Quantized Models Download List
🔍 Recommended Quantizations
- ✨ General CPU Use:
Q4_K_M(Best balance of speed/quality) - 📱 ARM Devices:
Q4_0(Optimized for ARM CPUs) - 🏆 Maximum Quality:
Q8_0(Near-original quality)
📦 Full Quantization Options
| 🚀 Download | 🔢 Type | 📝 Notes |
|---|---|---|
| Download |  |
Basic quantization |
| Download |  |
Small size |
| Download |  |
Balanced quality |
| Download |  |
Better quality |
| Download |  |
Fast on ARM |
| Download |  |
Fast, recommended |
| Download |  ⭐ |
Best balance |
| Download |  |
Good quality |
| Download |  |
Balanced |
| Download |  |
High quality |
| Download |  🏆 |
Very good quality |
| Download |  ⚡ |
Fast, best quality |
| Download |  |
Maximum accuracy |
💡 Tip: Use F16 for maximum precision when quality is critical
🚀 Applications and Tools for Locally Quantized LLMs
🖥️ Desktop Applications
| Application | Description | Download Link |
|---|---|---|
| Llama.cpp | A fast and efficient inference engine for GGUF models. | GitHub Repository |
| Ollama | A streamlined solution for running LLMs locally. | Website |
| AnythingLLM | An AI-powered knowledge management tool. | GitHub Repository |
| Open WebUI | A user-friendly web interface for running local LLMs. | GitHub Repository |
| GPT4All | A user-friendly desktop application supporting various LLMs, compatible with GGUF models. | GitHub Repository |
| LM Studio | A desktop application designed to run and manage local LLMs, supporting GGUF format. | Website |
| GPT4All Chat | A chat application compatible with GGUF models for local, offline interactions. | GitHub Repository |
📱 Mobile Applications
| Application | Description | Download Link |
|---|---|---|
| ChatterUI | A simple and lightweight LLM app for mobile devices. | GitHub Repository |
| Maid | Mobile Artificial Intelligence Distribution for running AI models on mobile devices. | GitHub Repository |
| PocketPal AI | A mobile AI assistant powered by local models. | GitHub Repository |
| Layla | A flexible platform for running various AI models on mobile devices. | Website |
🎨 Image Generation Applications
| Application | Description | Download Link |
|---|---|---|
| Stable Diffusion | An open-source AI model for generating images from text. | GitHub Repository |
| Stable Diffusion WebUI | A web application providing access to Stable Diffusion models via a browser interface. | GitHub Repository |
| Local Dream | Android Stable Diffusion with Snapdragon NPU acceleration. Also supports CPU inference. | GitHub Repository |
| Stable-Diffusion-Android (SDAI) | An open-source AI art application for Android devices, enabling digital art creation. | GitHub Repository |