hassanalameri-DeepSeek-R1-Distill-Qwen-14B-SIOPENGLISHGRAMMAR3.F16.Q4_K_M.gguf

Overview (EN)

This repository provides a q4_k_m-quantized GGUF file derived from hassanalameri/DeepSeek-R1-Distill-Qwen-14B-SIOPENGLISHGRAMMAR3.

Quick Start (llama.cpp)

./build/bin/llama-cli -m hassanalameri-DeepSeek-R1-Distill-Qwen-14B-SIOPENGLISHGRAMMAR3.F16.Q4_K_M.gguf -p "Hello"

Quantization

  • Format: GGUF
  • Method: q4_k_m
  • File: hassanalameri-DeepSeek-R1-Distill-Qwen-14B-SIOPENGLISHGRAMMAR3.F16.Q4_K_M.gguf
  • Size: ~8.37 GB

Provenance

  • Base model: hassanalameri/DeepSeek-R1-Distill-Qwen-14B-SIOPENGLISHGRAMMAR3

Note: This repo contains inference-only quantized weights. Respect the upstream license and usage terms.


Présentation (FR)

Ce dépôt fournit un fichier GGUF q4_k_m issu de hassanalameri/DeepSeek-R1-Distill-Qwen-14B-SIOPENGLISHGRAMMAR3.

Démarrage rapide (llama.cpp)

./build/bin/llama-cli -m hassanalameri-DeepSeek-R1-Distill-Qwen-14B-SIOPENGLISHGRAMMAR3.F16.Q4_K_M.gguf -p "Bonjour"

Quantification

  • Format : GGUF
  • Méthode : q4_k_m
  • Fichier : hassanalameri-DeepSeek-R1-Distill-Qwen-14B-SIOPENGLISHGRAMMAR3.F16.Q4_K_M.gguf
  • Taille : ~8.37 Go

Provenance

  • Modèle amont : hassanalameri/DeepSeek-R1-Distill-Qwen-14B-SIOPENGLISHGRAMMAR3

Remarque : Ce dépôt contient uniquement des poids quantifiés pour l'inférence. Merci de respecter la licence et les conditions d'utilisation du modèle d'origine.

Downloads last month
27
GGUF
Model size
15B params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ramgpt/DeepSeek-R1-Distill-Qwen-14B-SIOPENGLISHGRAMMAR3-GGUF-Q4_K_M