RedHatAI/Qwen2-0.5B-Instruct-quantized.w4a16
Text Generation
•
0.6B
•
Updated
•
18
RedHatAI/Qwen2-72B-Instruct-quantized.w8a16
Text Generation
•
73B
•
Updated
•
1
•
1
RedHatAI/Qwen2-7B-Instruct-quantized.w8a16
Text Generation
•
8B
•
Updated
•
9
RedHatAI/Qwen2-1.5B-Instruct-quantized.w8a16
Text Generation
•
2B
•
Updated
•
1
RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a16
Text Generation
•
0.5B
•
Updated
•
1
RedHatAI/Llama-2-7b-chat-quantized.w4a16
Text Generation
•
7B
•
Updated
•
22
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w4a16
Text Generation
•
8B
•
Updated
•
68
•
2
RedHatAI/Llama-2-7b-chat-quantized.w8a16
Text Generation
•
7B
•
Updated
•
3
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a16
Text Generation
•
7B
•
Updated
•
197
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a16
Text Generation
•
71B
•
Updated
•
751
•
6
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a16
Text Generation
•
8B
•
Updated
•
241
•
3
RedHatAI/SparseLLama-2-7b-ultrachat_200k-pruned_50.2of4
Text Generation
•
7B
•
Updated
•
2
RedHatAI/SparseLlama-2-7b-evolcodealpaca-pruned_50.2of4
Text Generation
•
7B
•
Updated
•
1
RedHatAI/Meta-Llama-3-70B-Instruct-FP8-KV
Text Generation
•
71B
•
Updated
•
2
•
3
RedHatAI/Llama-2-7b-gsm8k-pruned_70
Text Generation
•
7B
•
Updated
•
3
RedHatAI/Llama-2-7b-gsm8k-pruned_50
Text Generation
•
7B
•
Updated
•
1
RedHatAI/Llama-2-7b-gsm8k
Text Generation
•
Updated
•
10
•
5
RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
•
7B
•
Updated
•
54k
•
23
RedHatAI/SparseLlama-2-7b-cnn-daily-mail-pruned_50.2of4
Text Generation
•
7B
•
Updated
RedHatAI/SparseLlama-2-7b-cnn-daily-mail-pruned_70
Updated
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_70-quantized-deepsparse
Text Generation
•
Updated
•
4
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_50-quantized-deepsparse
Text Generation
•
Updated
•
4
RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_70-quantized-deepsparse
Text Generation
•
Updated
•
2
•
1
RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_50-quantized-deepsparse
Text Generation
•
Updated
•
2
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_70
Text Generation
•
7B
•
Updated
•
1
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_50
Text Generation
•
7B
•
Updated
•
2
RedHatAI/Llama-2-7b-cnn-daily-mail
Text Generation
•
7B
•
Updated
•
3
RedHatAI/Llama-2-7b-ultrachat200k-pruned_70
Text Generation
•
7B
•
Updated
•
2
RedHatAI/Llama-2-7b-ultrachat200k-pruned_70-quantized-deepsparse
Text Generation
•
Updated
•
1
RedHatAI/Llama-2-7b-ultrachat200k-pruned_50
Text Generation
•
7B
•
Updated
•
17