Please test

#461
by xesole3024 - opened

When I tried it I got an error with the model architecture. I'll try again later when vllm has better support for it.

alright, thanks

Sign up or log in to comment