RedHatAI/Kimi-K2-Instruct-quantized.w4a16
Text Generation
•
146B
•
Updated
•
208
•
12
Edit Models filters
Apps
Inference Providers
Active filters:
neuralmagic
nm-testing/Llama-3.1-8B-Instruct-speculator.eagle3-converted
Text Generation
•
1.0B
•
Updated
•
10
RedHatAI/SmolLM3-3B-quantized.w4a16
0.9B
•
Updated
•
313
•
1
LiyuanLucasLiu/Qwen2.5-0.5B-Instruct-quantized.w8a8-RedHatAI
Text Generation
•
0.6B
•
Updated
•
18
RedHatAI/Devstral-Small-2507-quantized.w8a8
Text Generation
•
24B
•
Updated
•
50
•
1
RedHatAI/Devstral-Small-2507-quantized.w4a16
Text Generation
•
4B
•
Updated
•
87
•
1
RedHatAI/Qwen3-14B-speculator.eagle3
Text Generation
•
1B
•
Updated
•
98
RedHatAI/Qwen3-32B-speculator.eagle3
Text Generation
•
2B
•
Updated
•
630
•
4
RedHatAI/Llama-3.3-70B-Instruct-speculator.eagle3
Text Generation
•
2B
•
Updated
•
1.38k
•
1
RedHatAI/Qwen3-8B-speculator.eagle3
Text Generation
•
1B
•
Updated
•
31.3k
RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-quantized.w4a16
Text Generation
•
2B
•
Updated
•
199
•
2
RedHatAI/gpt-oss-20b-speculator.eagle3
Text Generation
•
0.9B
•
Updated
•
73.1k
RedHatAI/Qwen3-235B-A22B-Instruct-2507-speculator.eagle3
Text Generation
•
1B
•
Updated
•
373
ChibuUkachi/Qwen3-4B-Instruct-2507.w4a16
Text Generation
•
1B
•
Updated
•
98
inference-optimization/Qwen3-4B-Thinking-2507.w4a16
Text Generation
•
1B
•
Updated
•
376
inference-optimization/Qwen3-4B-Instruct-2507.w4a16
Text Generation
•
1B
•
Updated
•
78
inference-optimization/Qwen3-30B-A3B-Thinking-2507.w4a16
Text Generation
•
5B
•
Updated
•
24
inference-optimization/Qwen3-30B-A3B-Instruct-2507.w4a16
Text Generation
•
5B
•
Updated
•
25
RedHatAI/Qwen3-30B-A3B-Instruct-2507-speculator.eagle3
Text Generation
•
Updated