GGUF
llama.cpp

Available Model files:

  • gemma-2-2b.Q8_0.gguf

Note

  • The model's BOS token behavior was adjusted for GGUF compatibility.
Downloads last month
13
GGUF
Model size
3B params
Architecture
gemma2
Hardware compatibility
Log In to view the estimation

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ss-lab/Gemma-2-2b-GGUF

Base model

google/gemma-2-2b
Quantized
(62)
this model

Dataset used to train ss-lab/Gemma-2-2b-GGUF

Collection including ss-lab/Gemma-2-2b-GGUF