Vortex Collection ModelCloud optimized and validated quants that pass/meet strict quality assurance on multiple benchmarks. No one quantize • 24 items • Updated Oct 30 • 10
view article Article Accelerating LLM Inference: Fast Sampling with Gumbel-Max Trick Oct 24, 2024 • 14