Credits

Qubitium and ModelCloud team for maintaining and improving GPTQModel
Elias Frantar, Saleh Ashkboos, Torsten Hoefler and Dan Alistarh: for creating GPTQ and Marlin.
PanQiWei: for creation of AutoGPTQ which this project code is based upon.
FXMarty: for maintaining and support of AutoGPTQ.
Qwopqwop200: for quantization code used in this project adapted from GPTQ-for-LLaMa.
Turboderp: for releasing Exllama v1 and Exllama v2 kernels adapted for use in this project.
FpgaMiner: for GPTQ-Triton kernels used in GPTQ-for-LLaMa which is adapted into this project.

Provide feedback