Code

add gptqmodel support#2247

Code

Merged

BenjaminBossan merged 27 commits intohuggingface:mainhuggingface/peft:mainfrom jiqing-feng:gptqjiqing-feng/peft:gptqCopy head branch name to clipboardJan 23, 2025

+508-37

Commits

Commits on Dec 3, 2024

• add gptqmodel support

  Show description for a69fd22
  jiqing-feng

  committed
  a69fd22

  Copy full SHA for a69fd22

Commits on Dec 4, 2024

• enable gptqmodel tests

  Show description for 3b87bae
  jiqing-feng

  committed
  3b87bae

  Copy full SHA for 3b87bae

Commits on Dec 5, 2024

• Fix Peft compat (#1)

  Show description for e17c4ea
  

  LRL-ModelCloud

  and

  Qubitium

  authored
  e17c4ea

  Copy full SHA for e17c4ea

Commits on Dec 16, 2024

• update gptqmodel version (#2)

  ZX-ModelCloud

  authored
  01c7429

  Copy full SHA for 01c7429

Commits on Jan 17, 2025

• check model has attr 'hf_device_map'

  LRL-ModelCloud

  committed
  c80fffd

  Copy full SHA for c80fffd

• update gptqmodel version

  Qubitium

  authored
  e887299

  Copy full SHA for e887299

• revert test_common_gpu.py and test_gpu_examples.py

  LRL-ModelCloud

  committed
  60c03af

  Copy full SHA for 60c03af

• add test_gptqmodel.py

  LRL-ModelCloud

  committed
  ec4d6fe

  Copy full SHA for ec4d6fe

• PeftGPTQModelCommonTests require gptqmodel

  LRL-ModelCloud

  committed
  b54d034

  Copy full SHA for b54d034

• cleanup

  LRL-ModelCloud

  committed
  12ab8a0

  Copy full SHA for 12ab8a0

• use peft_model.device

  LRL-ModelCloud

  committed
  c8c3d8e

  Copy full SHA for c8c3d8e

• format code

  LRL-ModelCloud

  committed
  946d1d7

  Copy full SHA for 946d1d7

• update copyright notice

  LRL-ModelCloud

  committed
  4f11d86

  Copy full SHA for 4f11d86

• device_map is optional

  LRL-ModelCloud

  committed
  4f13f7b

  Copy full SHA for 4f13f7b

• update Makefle, add test_gptqmodel_gpu

  LRL-ModelCloud

  committed
  9fcdd02

  Copy full SHA for 9fcdd02

• Merge branch 'huggingface:main' into gptq

  LRL-ModelCloud

  authored
  17440c4

  Copy full SHA for 17440c4

• add get_gptqmodel_quant_linear to __all__

  LRL-ModelCloud

  committed
  c206e7b

  Copy full SHA for c206e7b

• add gptq to quantization.md

  Qubitium

  authored
  e0439fd

  Copy full SHA for e0439fd

• Update quantization.md

  Qubitium

  authored
  1f79dae

  Copy full SHA for 1f79dae

• cleanup

  LRL-ModelCloud

  committed
  c15a302

  Copy full SHA for c15a302

• Merge remote-tracking branch 'origin/gptq' into gptq

  LRL-ModelCloud

  committed
  6a3adc6

  Copy full SHA for 6a3adc6

• cleanup

  LRL-ModelCloud

  committed
  59932fd

  Copy full SHA for 59932fd

Commits on Jan 18, 2025

• Update docs/source/developer_guides/quantization.md

  Show description for 75ddd5e
  

  Qubitium

  and

  stevhliu

  authored
  75ddd5e

  Copy full SHA for 75ddd5e

• Update docs/source/developer_guides/quantization.md

  Show description for dab7a54
  

  Qubitium

  and

  stevhliu

  authored
  dab7a54

  Copy full SHA for dab7a54

Commits on Jan 22, 2025

• Merge branch 'huggingface:main' into gptq

  LRL-ModelCloud

  authored
  d5e55b6

  Copy full SHA for d5e55b6

• pass device_map as a keyword argument

  LRL-ModelCloud

  committed
  540e5af

  Copy full SHA for 540e5af

• add optimum version check for gptqmodel compatibility

  LRL-ModelCloud

  committed
  fa3ab05

  Copy full SHA for fa3ab05