--- tags: - gguf - llama.cpp - unsloth --- # aeb_tdu_ex02ReTre - GGUF This model was finetuned and converted to GGUF format using [Unsloth](https://github.com/unslothai/unsloth). **Example usage**: - For text only LLMs: **llama-cli** **--hf** repo_id/model_name **-p** "why is the sky blue?" - For multimodal models: **llama-mtmd-cli** **-m** model_name.gguf **--mmproj** mmproj_file.gguf ## Available Model files: - `meta-llama-3.1-8b.Q4_K_M.gguf`