Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
QwQ-32B-Preview-quantized.w8a8
like
0
Follow
Red Hat AI
1.75k
Text Generation
Transformers
Safetensors
English
qwen2
w8a8
int8
vllm
conversational
text-generation-inference
8-bit precision
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
QwQ-32B-Preview-quantized.w8a8
34.3 GB
2 contributors
History:
3 commits
Eldar Kurtic
add model
bf17e01
12 months ago
.gitattributes
1.57 kB
add model
12 months ago
README.md
8.66 kB
add model
12 months ago
added_tokens.json
605 Bytes
add model
12 months ago
config.json
1.8 kB
add model
12 months ago
generation_config.json
213 Bytes
add model
12 months ago
merges.txt
1.67 MB
add model
12 months ago
model-00001-of-00007.safetensors
5 GB
xet
add model
12 months ago
model-00002-of-00007.safetensors
4.91 GB
xet
add model
12 months ago
model-00003-of-00007.safetensors
4.88 GB
xet
add model
12 months ago
model-00004-of-00007.safetensors
4.88 GB
xet
add model
12 months ago
model-00005-of-00007.safetensors
4.88 GB
xet
add model
12 months ago
model-00006-of-00007.safetensors
4.88 GB
xet
add model
12 months ago
model-00007-of-00007.safetensors
4.91 GB
xet
add model
12 months ago
model.safetensors.index.json
102 kB
add model
12 months ago
quant_w8a8.sh
610 Bytes
add model
12 months ago
recipe.yaml
147 Bytes
add model
12 months ago
special_tokens_map.json
613 Bytes
add model
12 months ago
tokenizer.json
11.4 MB
xet
add model
12 months ago
tokenizer_config.json
7.41 kB
add model
12 months ago
vocab.json
2.78 MB
add model
12 months ago
w8a8.py
4.26 kB
add model
12 months ago
