AutoGPTQ/auto_gptq/modeling
2023-05-24 17:43:38 +08:00
..
__init__.py fix device mismatch when directly using model to inference after quantization 2023-04-28 16:41:46 +08:00
_base.py correct typo of function name 2023-05-24 17:43:38 +08:00
_const.py add library version comparison help functions 2023-05-14 16:16:06 +08:00
_utils.py correct typo of function name 2023-05-24 17:43:38 +08:00
auto.py remove full_cpu_offload argument and unify model dispatch strategy 2023-05-24 17:41:04 +08:00
bloom.py support dispatch layers to different devices when loading pretrained model before quantization 2023-04-27 02:24:08 +08:00
gpt2.py fix device mismatch when directly using model to inference after quantization 2023-04-28 16:41:46 +08:00
gpt_neox.py support dispatch layers to different devices when loading pretrained model before quantization 2023-04-27 02:24:08 +08:00
gptj.py add GPTJ fused attention module 2023-05-14 16:17:21 +08:00
llama.py make compatible with older transformers version 2023-05-15 13:26:18 +08:00
moss.py remove non-parameters module from MOSSGPTQForCausalLM.outside_layer_modules 2023-04-29 10:58:29 +08:00
opt.py remove override of _resize_attention_mask for llama and opt 2023-04-28 23:08:42 +08:00