David Euler

davideuler's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in mlx-community/gemma-2-27b-it-4bit about 1 year ago

The model only generates <pad> token

1

#2 opened over 1 year ago by

Hyeongdon

New activity in YorkieOH10/granite-34b-code-instruct-Q8_0-GGUF almost 2 years ago

Failed to load model

3

#1 opened almost 2 years ago by

davideuler

New activity in Dracones/WizardLM-2-8x22B_exl2_4.0bpw almost 2 years ago

Can this version be loaded with vllm?

2

#1 opened almost 2 years ago by

wawoshashi

New activity in Dracones/WizardLM-2-8x22B_exl2_2.5bpw almost 2 years ago

Could you help to create the 3.25bpw model so it can fits on A100?

4

#1 opened almost 2 years ago by

davideuler

New activity in turboderp/Mixtral-8x7B-instruct-exl2 almost 2 years ago

bpw and corresponding vram usage

👍 10

18

#1 opened about 2 years ago by

joujiboi

New activity in alpindale/c4ai-command-r-plus-GPTQ almost 2 years ago

How to load command r+ in text-generation-webui?

5

#1 opened almost 2 years ago by

MLDataScientist

New activity in stabilityai/stable-code-3b almost 2 years ago

How could I run inference with the gguf models?

6

#6 opened about 2 years ago by

davideuler

New activity in brittlewis12/gorilla-openfunctions-v2-GGUF almost 2 years ago

I wonder how did you create the GGUF model?

2

#1 opened almost 2 years ago by

davideuler

New activity in stabilityai/stable-code-3b about 2 years ago

How could I run inference with the gguf models?

6

#6 opened about 2 years ago by

davideuler