- Q6F: Q6_K ffns
- Q8A: Q8_0 attn, other layers
Fits long context on a 24GiB GPU
- Downloads last month
- 155
Hardware compatibility
Log In
to view the estimation
We're not able to determine the quantization variants.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for Beinsezii/Mistral-Small-3.2-24B-Instruct-2506-Q6F-Q8A-GGUF
Base model
mistralai/Mistral-Small-3.1-24B-Base-2503