RedHatAI/Qwen2.5-7B-quantized.w8a16
Text Generation
•
3B
•
Updated
•
13
•
1
RedHatAI/Qwen2.5-3B-quantized.w8a16
Text Generation
•
1B
•
Updated
•
12
RedHatAI/Qwen2.5-0.5B-quantized.w8a16
Text Generation
•
0.4B
•
Updated
•
34
RedHatAI/Qwen2.5-1.5B-quantized.w8a16
Text Generation
•
0.8B
•
Updated
•
19
RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4
Text Generation
•
8B
•
Updated
•
16
•
1
RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4
Text Generation
•
8B
•
Updated
•
14
•
1
RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4
Text Generation
•
8B
•
Updated
•
20
•
1
RedHatAI/Llama-3.1-8B-gsm8k
8B
•
Updated
•
7
RedHatAI/Llama-3.1-8B-evolcodealpaca
8B
•
Updated
•
8
RedHatAI/Llama-3.1-8B-ultrachat_200k
8B
•
Updated
•
9
RedHatAI/granite-3.0-1b-a400m-instruct-GGUF
1B
•
Updated
•
5
RedHatAI/granite-3.0-2b-instruct-GGUF
3B
•
Updated
•
2
RedHatAI/granite-3.0-3b-a800m-instruct-GGUF
3B
•
Updated
•
8
RedHatAI/granite-3.0-8b-instruct-GGUF
8B
•
Updated
•
2
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
Text Generation
•
3B
•
Updated
•
2.29k
•
12
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8
Text Generation
•
8B
•
Updated
•
80
•
5
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic
Text Generation
•
71B
•
Updated
•
2.32k
•
7
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic
Text Generation
•
406B
•
Updated
•
4.08k
•
15
RedHatAI/Qwen2.5-32B-Instruct-quantized.w4a16
6B
•
Updated
•
8
RedHatAI/Qwen2.5-32B-quantized.w4a16
6B
•
Updated
•
14
RedHatAI/Qwen2.5-72B-quantized.w4a16
12B
•
Updated
•
6
RedHatAI/Qwen2.5-72B-Instruct-quantized.w4a16
12B
•
Updated
•
150
RedHatAI/Qwen2.5-72B-Instruct-quantized.w8a16
20B
•
Updated
•
13
RedHatAI/Qwen2.5-1.5B-Instruct-quantized.w8a16
0.8B
•
Updated
•
6
RedHatAI/Qwen2.5-3B-Instruct-quantized.w8a16
1B
•
Updated
•
9
RedHatAI/Llama-3.2-3B-Instruct-FP8
Text Generation
•
4B
•
Updated
•
1.57k
•
6
RedHatAI/Llama-3.2-1B-Instruct-FP8
Text Generation
•
1B
•
Updated
•
177k
•
3
RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8
Text Generation
•
1B
•
Updated
•
10.6k
•
7
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16
Text Generation
•
58B
•
Updated
•
36
•
12
RedHatAI/Llama-3.2-3B-quantized.w8a8
4B
•
Updated
•
2.15k