Skip to content

Allow GPTQModel to auto select Marlin or faster kernels for inference… #3879

Allow GPTQModel to auto select Marlin or faster kernels for inference…

Allow GPTQModel to auto select Marlin or faster kernels for inference… #3879