6 GB

1 contributor

History: 157 commits

geoffmunn

Update Q4_Quantization_Comparison.md

273fcfd verified 1 day ago

Qwen3-0.6B-f16-Q2_K
f16 path changed about 1 month ago
Qwen3-0.6B-f16-Q3_K_M
f16 path changed about 1 month ago
Qwen3-0.6B-f16-Q3_K_S
f16 path changed about 1 month ago
Qwen3-0.6B-f16-Q4_K_M
f16 path changed about 1 month ago
Qwen3-0.6B-f16-Q4_K_S
Rename Qwen3-0.6B-Q4_K_S/README.md to Qwen3-0.6B-f16-Q4_K_S/README.md about 1 month ago
Qwen3-0.6B-f16-Q5_K_M
f16 path changed about 1 month ago
Qwen3-0.6B-f16-Q5_K_S
f16 path changed about 1 month ago
Qwen3-0.6B-f16-Q6_K
f16 path changed about 1 month ago
Qwen3-0.6B-f16-Q8_0
f16 path changed about 1 month ago
.gitattributes

4.15 kB

Upload Q4_K_HIFI + imatrix quantized model 2 days ago
MODELFILE

522 Bytes

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload 4 months ago
Q3_Quantisation_Comparison.md

4.95 kB

Update Q3_Quantisation_Comparison.md 17 days ago
Q4_Quantization_Comparison.md

9.83 kB

Update Q4_Quantization_Comparison.md 1 day ago
Qwen3-0.6B-f16-imatrix-4697.gguf

1.18 MB
xet

Upload imatrix gguf 2 days ago
Qwen3-0.6B-f16-imatrix:Q4_K_HIFI.gguf

517 MB
xet

Upload Q4_K_HIFI + imatrix quantized model 2 days ago
Qwen3-0.6B-f16-imatrix:Q4_K_M.gguf

484 MB
xet

Upload Q4_K_M + imatrix quantized model 2 days ago
Qwen3-0.6B-f16-imatrix:Q4_K_S.gguf

471 MB
xet

Upload Q4_K_S + imatrix quantized model 2 days ago
Qwen3-0.6B-f16:Q2_K.gguf

347 MB
xet

Rename Qwen3-0.6B-f16-Q2_K.gguf to Qwen3-0.6B-f16:Q2_K.gguf about 1 month ago
Qwen3-0.6B-f16:Q3_HIFI.gguf

329 MB
xet

Rename Qwen3-0.6B-f16-Q3_HIFI.gguf to Qwen3-0.6B-f16:Q3_HIFI.gguf about 1 month ago
Qwen3-0.6B-f16:Q3_K_M.gguf

414 MB
xet

Rename Qwen3-0.6B-f16-Q3_K_M.gguf to Qwen3-0.6B-f16:Q3_K_M.gguf about 1 month ago
Qwen3-0.6B-f16:Q3_K_S.gguf

390 MB
xet

Rename Qwen3-0.6B-f16-Q3_K_S.gguf to Qwen3-0.6B-f16:Q3_K_S.gguf about 1 month ago
Qwen3-0.6B-f16:Q4_K_HIFI.gguf

517 MB
xet

Upload Q4_K_HIFI quantized model 2 days ago
Qwen3-0.6B-f16:Q5_K_M.gguf

551 MB
xet

Rename Qwen3-0.6B-f16-Q5_K_M.gguf to Qwen3-0.6B-f16:Q5_K_M.gguf about 1 month ago
Qwen3-0.6B-f16:Q5_K_S.gguf

544 MB
xet

Rename Qwen3-0.6B-f16-Q5_K_S.gguf to Qwen3-0.6B-f16:Q5_K_S.gguf about 1 month ago
Qwen3-0.6B-f16:Q6_K.gguf

623 MB
xet

Rename Qwen3-0.6B-f16-Q6_K.gguf to Qwen3-0.6B-f16:Q6_K.gguf about 1 month ago
Qwen3-0.6B-f16:Q8_0.gguf

805 MB
xet

Rename Qwen3-0.6B-f16-Q8_0.gguf to Qwen3-0.6B-f16:Q8_0.gguf about 1 month ago
Qwen3-0.6b-f16-analysis.md

65 kB

FIle names fixed about 1 month ago
README.md

7.41 kB

Update README.md 6 days ago
mixed-imatrix-dataset.txt

10.3 MB

imatrix dataset 2 days ago