Jarten's picture

7 3

Jarten

jart25

·

AI & ML interests

None yet

Organizations

None yet

New activity in cyankiwi/Qwen3-VL-30B-A3B-Instruct-AWQ-8bit 3 months ago

Quant AWQ RDNA3 ROCM

#1 opened 3 months ago by

New activity in QuantTrio/Qwen3-VL-30B-A3B-Instruct-AWQ 3 months ago

How the model was quantized and which library was used

#4 opened 3 months ago by

New activity in jart25/Qwen3-Next-80B-A3B-Instruct-Int4-GPTQ 3 months ago

Running on 2xAI Pro R9700s via ROCM 7 and nightly VLLM with this

#1 opened 3 months ago by

New activity in QuantTrio/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int8 5 months ago

Request: Qwen3-30B-A3B-Instruct-2507-GPTQ-Int4

#1 opened 5 months ago by

New activity in Qwen/Qwen3-30B-A3B-Instruct-2507 5 months ago

Qwen3-30B-A3B-Instruct-2507-Autoround-Int-4bit-gptq

#7 opened 5 months ago by

New activity in Qwen/Qwen3-30B-A3B-Thinking-2507 5 months ago

Using vllm 0.10.0, `reasoning content` appears in content field instead of reasoning_content with Qwen3-30B-A3B-Thinking model

#2 opened 5 months ago by

New activity in Qwen/Qwen3-30B-A3B-Instruct-2507 5 months ago

AWQ version

#3 opened 5 months ago by

New activity in QuantTrio/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int8 5 months ago

Request: Qwen3-30B-A3B-Instruct-2507-GPTQ-Int4

#1 opened 5 months ago by

New activity in Qwen/Qwen3-30B-A3B-Instruct-2507 5 months ago

Qwen3-30B-A3B-Instruct-2507-Autoround-Int-4bit-gptq

#7 opened 5 months ago by