会不会出30B-A3B版本的？

by RoadToNowhere - opened 29 days ago

29 days ago

30B-A3B-2507的智能明显强很多，3B激活参数用llama.cpp卸载ffn层到CPU也能在小显存的卡上跑出不错的速度，就是微调成本有点高

SakuraLLM org 28 days ago

会有的

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment