Creating our own "pig" ggufs?

#3
by baesik - opened

Is there a way to quantize models to this "pig" architecture ourselves to benefit from faster loading?

Owner

please refer to this; you could probably make it yourself

Sign up or log in to comment