Add README
Browse files
README.md
CHANGED
|
@@ -15,7 +15,8 @@ This model was finetuned and converted to GGUF format using [Unsloth](https://gi
|
|
| 15 |
- For multimodal models: **llama-mtmd-cli** **-m** model_name.gguf **--mmproj** mmproj_file.gguf
|
| 16 |
|
| 17 |
## Available Model files:
|
| 18 |
-
- `Meta-Llama-3.1-8B-Instruct.
|
|
|
|
| 19 |
|
| 20 |
## Ollama
|
| 21 |
An Ollama Modelfile is included for easy deployment.
|
|
|
|
| 15 |
- For multimodal models: **llama-mtmd-cli** **-m** model_name.gguf **--mmproj** mmproj_file.gguf
|
| 16 |
|
| 17 |
## Available Model files:
|
| 18 |
+
- `Meta-Llama-3.1-8B-Instruct.Q5_K_M.gguf`
|
| 19 |
+
- `Meta-Llama-3.1-8B-Instruct.Q8_0.gguf`
|
| 20 |
|
| 21 |
## Ollama
|
| 22 |
An Ollama Modelfile is included for easy deployment.
|