RedHatAI/Qwen2.5-3B-Instruct-quantized.w8a8
3B
•
Updated
•
7
RedHatAI/Qwen2.5-1.5B-Instruct-quantized.w8a8
2B
•
Updated
•
6
RedHatAI/SparseLlama-3-8B-pruned_50.2of4
Text Generation
•
8B
•
Updated
•
16
RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic
Text Generation
•
89B
•
Updated
•
2.75k
•
11
RedHatAI/Llama-3.2-11B-Vision-Instruct-FP8-dynamic
Text Generation
•
11B
•
Updated
•
13.4k
•
24
RedHatAI/Phi-3.5-mini-instruct-FP8-KV
Text Generation
•
4B
•
Updated
•
57
•
2
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w4a16
Text Generation
•
71B
•
Updated
•
117
•
2
RedHatAI/Mixtral-8x22B-Instruct-v0.1-AutoFP8
Text Generation
•
141B
•
Updated
•
22
•
3
RedHatAI/DeepSeek-Coder-V2-Base-FP8
Text Generation
•
236B
•
Updated
•
24
RedHatAI/DeepSeek-Coder-V2-Instruct-FP8
Text Generation
•
236B
•
Updated
•
185
•
7
RedHatAI/Mistral-Nemo-Instruct-2407-FP8
Text Generation
•
12B
•
Updated
•
1.16k
•
18
RedHatAI/Qwen2-57B-A14B-Instruct-FP8
Text Generation
•
57B
•
Updated
•
549
•
1
RedHatAI/Llama-2-7b-chat-hf-FP8
Text Generation
•
7B
•
Updated
•
77
RedHatAI/Mistral-7B-Instruct-v0.3-FP8
Text Generation
•
7B
•
Updated
•
660
•
3
RedHatAI/Qwen2-0.5B-Instruct-FP8
Text Generation
•
0.5B
•
Updated
•
280
•
3
RedHatAI/Qwen2-1.5B-Instruct-FP8
Text Generation
•
2B
•
Updated
•
8k
RedHatAI/Qwen2-7B-Instruct-FP8
Text Generation
•
8B
•
Updated
•
11.7k
•
•
2
RedHatAI/Qwen2-72B-Instruct-FP8
Text Generation
•
73B
•
Updated
•
1.22k
•
15
RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8
Text Generation
•
47B
•
Updated
•
45
•
3
RedHatAI/Meta-Llama-3-70B-Instruct-FP8
Text Generation
•
71B
•
Updated
•
1.07k
•
•
13
RedHatAI/Meta-Llama-3-8B-Instruct-FP8
Text Generation
•
8B
•
Updated
•
2.52k
•
•
24
RedHatAI/DeepSeek-Coder-V2-Lite-Base-FP8
Text Generation
•
16B
•
Updated
•
22
RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8
Text Generation
•
16B
•
Updated
•
23.6k
•
9
RedHatAI/Qwen2-7B-Instruct-quantized.w4a16
Text Generation
•
8B
•
Updated
•
34
RedHatAI/Qwen2-72B-Instruct-quantized.w4a16
Text Generation
•
73B
•
Updated
•
147
•
4
RedHatAI/Qwen2-1.5B-Instruct-quantized.w4a16
Text Generation
•
2B
•
Updated
•
17
RedHatAI/Qwen2-0.5B-Instruct-quantized.w4a16
Text Generation
•
0.6B
•
Updated
•
84
RedHatAI/Qwen2-72B-Instruct-quantized.w8a16
Text Generation
•
73B
•
Updated
•
15
•
1
RedHatAI/Qwen2-7B-Instruct-quantized.w8a16
Text Generation
•
8B
•
Updated
•
26