nm-testing/gemma-3-4b-it-quantized.w8a8_previous
29B
•
Updated
nm-testing/gemma-3-4b-it-quantized.w8a8_temp
5B
•
Updated
nm-testing/Mistral-Small-3.1-24B-Instruct-2503-W4A16-G128
4B
•
Updated
nm-testing/Meta-Llama-3-8B-Instruct-NVFP4-updated-v2
5B
•
Updated
nm-testing/Llama-3.1-8B-Instruct-NVFP4A16-temp2
5B
•
Updated
nm-testing/Llama-3.1-8B-Instruct-NVFP4-v4-temp
5B
•
Updated
nm-testing/Llama-3.1-8B-Instruct-NVFP4A16-temp
5B
•
Updated
•
6
nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4-v5
0.7B
•
Updated
•
6
nm-testing/DeepSeek-V2-Lite-W8A8-Dynamic-Per-Token
16B
•
Updated
•
2
nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4-Updated4
0.7B
•
Updated
nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4-Updated3
0.7B
•
Updated
nm-testing/Devstral-Small-2505-FP8-dynamic
Text Generation
•
24B
•
Updated
•
95
•
1
nm-testing/Mixtral-8x7B-Instruct-v0.1-W8A8-updated-smoothquant
47B
•
Updated
nm-testing/Llama-4-Maverick-17B-128E-Instruct-for-quant
402B
•
Updated
•
8
nm-testing/Sparse-Llama-3.1-8B-2of4-tldr
Text Generation
•
5B
•
Updated
•
1
nm-testing/DeepSeek-Coder-V2-Lite-Instruct-W8A8-smoothquant
16B
•
Updated
•
2
nm-testing/DeepSeek-Coder-V2-Lite-Instruct-W8A8-No-smoothquant
16B
•
Updated
•
5
nm-testing/Mixtral-8x7B-Instruct-v0.1-W8A8-No-Smoothquant
47B
•
Updated
•
1
nm-testing/llama2.c-stories15M-ultrachat-mixed-compressed
14.6M
•
Updated
•
493
nm-testing/llama2.c-stories15M-ultrachat-mixed-uncompressed
24.4M
•
Updated
•
896
nm-testing/Mixtral-8x7B-Instruct-v0.1-W8A8
47B
•
Updated
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP4
0.7B
•
Updated
•
39
•
1
nm-testing/Llama-4-Scout-17B-16E-Instruct-for-quant
109B
•
Updated
•
2
nm-testing/Llama-3_1-Nemotron-Ultra-253B-v1-FP8-dynamic
253B
•
Updated
•
7
•
2
nm-testing/Mistral-Small-3.1-24B-Instruct-2503-FP8
Image-Text-to-Text
•
Updated
•
4
•
3
nm-testing/DeepSeek-Coder-V2-Lite-Instruct-quantized.w8a8
16B
•
Updated
•
4
nm-testing/l4-scout-int4-debug
20B
•
Updated
nm-testing/pixtral-12b-FP8-dynamic
Image-to-Text
•
13B
•
Updated
•
9.12k
•
1
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-Asym-Updated-ActOrder
0.3B
•
Updated
•
2.28k
nm-testing/TinyLlama-1.1B-Chat-v1.0-awq-group128-asym256
0.3B
•
Updated