Add GGUF quantized models (Q4_0, Q4_K_M, Q5_K_M, Q8_0, F32) 59e9f80 aguitauwu commited on 21 days ago