Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,474

Full-text search

Active filters: quantized

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12, 2025 • 103k • 17

MaziyarPanahi/DeepSeek-V3-0324-GGUF

Text Generation • 671B • Updated Mar 25, 2025 • 102k • 22

ABDALLALSWAITI/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • Updated Apr 19, 2025 • 4.19k • 55

nvidia/DeepSeek-R1-0528-NVFP4-v2

Text Generation • 394B • Updated Sep 2, 2025 • 148k • 16

nvidia/Qwen3-235B-A22B-Eagle3

Text Generation • 0.3B • Updated Jan 26 • 3.58k • 12

stevenalbert10/gemma3-27b-gguf

Text Generation • 27B • Updated Jul 26, 2025 • 8 • 1

nvidia/gpt-oss-120b-Eagle3-long-context

Text Generation • 0.2B • Updated Jan 26 • 19.7k • 62

beenyb/financial-gpt-oss-20b-q8

Text Generation • 12B • Updated Sep 2, 2025 • 256 • 4

Immac/NetaYume-Lumina-Image-2.0-GGUF

Text-to-Image • 3B • Updated Aug 23, 2025 • 241 • 7

2imi9/gpt-oss-20B-NVFP4A16-BF16

Text Generation • 21B • Updated Dec 19, 2025 • 1.56k • 4

nvidia/Phi-4-multimodal-instruct-FP8

6B • Updated Sep 5, 2025 • 14.9k • 5

nvidia/Qwen3-8B-FP8

Text Generation • 8B • Updated Sep 9, 2025 • 8.78k • 4

vito95311/Qwen3-Omni-30B-A3B-Thinking-INT8FP16

Text Generation • 32B • Updated Sep 24, 2025 • 6 • 5

mlx-community/LFM2-8B-A1B-3bit-MLX

Text Generation • 1B • Updated Oct 8, 2025 • 71 • 2

RedHatAI/granite-4.0-h-small-FP8-dynamic

Text Generation • 32B • Updated 10 days ago • 718 • 2

aninokumar/Qwen3-8B-M2V-Entropy-RAG

Updated Nov 10, 2025 • 7 • 1

magiccodingman/Qwen3-VL-8B-Instruct-Unsloth-MXFP4-Hybrid-GGUF

Text Generation • 8B • Updated Dec 3, 2025 • 192 • 2

logos-flux/Qwen3-4B-Instruct-2507-heretic-GGUF

4B • Updated Nov 22, 2025 • 204 • 1

nvidia/Qwen3-Next-80B-A3B-Instruct-NVFP4

Text Generation • Updated 25 days ago • 50.3k • 32

unsloth/Qwen-Image-GGUF

Text-to-Image • 20B • Updated Dec 22, 2025 • 954 • 25

sh0ck0r/Llama-3.3-70B-Vulpecula-r1-FP8-Dynamic

Text Generation • 71B • Updated Dec 24, 2025 • 5 • 1

nvidia/DeepSeek-V3.2-NVFP4

Text Generation • 394B • Updated Jan 21 • 21.6k • 7

nvidia/Qwen3-235B-A22B-Instruct-2507-NVFP4

Text Generation • 120B • Updated Jan 30 • 3.77k • 4

0xSero/GLM-4.7-REAP-50-W4A16

Text Generation • Updated Jan 5 • 410 • 68

yepthatsjason/Mistral-Small-3.2-24B-Instruct-2506-nvfp4

Text Generation • 14B • Updated Jan 10 • 97 • 1

distil-labs/distil-qwen3-4b-text2sql-gguf-4bit

Text Generation • 4B • Updated Jan 11 • 112 • 4

nvidia/Qwen3-Coder-480B-A35B-Instruct-NVFP4

Text Generation • 241B • Updated 29 days ago • 1.3k • 3

QuantFunc/Nunchaku-Qwen-Image-2512

Text-to-Image • Updated 7 days ago • 4.72k • 71

GadflyII/GLM-4.7-Flash-NVFP4

Text Generation • Updated Jan 20 • 261k • 65

solarkyle/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 20 • 144 • 3