GPTQModel v0.9.0
What's Changed (First Release since AutoGPTQ fork)
4 New Models plus sym=False asymmetry and lm_head quantized inference support.
- ✨ [FEATURE/BUG]
sym=falsesupport by @qwopqwop200, @Qubitium, @fxmarty - ✨ [FEATURE]
lm_headquantization inference by @Qubitium - 🚀 [MODEL] ChatGLM by @LRL-ModelCloud @Qubitium
- 🚀 [MODEL] MiniCPM model support by @LDLINGLINGLING, @Qubitium in #18
- 🚀 [MODEL] Phi-3 model support by @davidgxue, @ZX-ModelCloud in #27
- 🚀 [MODEL] QwenMoE model support by @bozheng-hit, @LRL-ModelCloud in #24
- 🚀 [CORE] Faster quantization and better quality (PPL) quant by @Qubitium
- 👾[BUG] H100 crash by @Qubitium
- 👾[BUG] Packing perf regression on high core-count systems by @Qubitium
- 🚀 [REFRACTOR] Major refractor and code debloat by @Qubitium
- 🤖 [CI] Code quality by @CSY-ModelCloud in #31
- 🤖 [CI] Add Perplexity regression test by @LRL-ModelCloud in #1
- 🤖 [CI] Add Runner by @CSY-ModelCloud in #3
Full Changelog: https://github.com/ModelCloud/GPTQModel/commits/v0.9.0
Contributors
Qubitium, bozheng-hit, and 7 other contributors