潘其威(William)
3de7fbb0d5
Revert "fix bug(breaking change) remove (zeors -= 1)"
2023-09-27 10:37:31 +08:00
潘其威(William)
62fd0371ac
Merge branch 'main' into main
2023-09-26 14:09:04 +08:00
潘其威(William)
b461b6fa13
Merge pull request #335 from z80maniac/ignore-extra-args
...
Ignore unknown parameters in quantize_config.json
2023-09-26 14:00:38 +08:00
Marc Sun
c912bf361a
exllamav2 integration
2023-09-25 16:51:18 +00:00
ZXED
121dbd15a5
Ignore unknown parameters in quantize_config.json
2023-09-10 18:39:40 +03:00
qwopqwop200
94de4ef185
GPTQ backward compatibility support
2023-09-08 10:16:29 +09:00
qwopqwop200
ad5b0d72ee
fix bug
2023-09-06 16:41:41 +09:00
潘其威(William)
1e938e6bad
Merge pull request #310 from PanQiWei/fix_to()_metod_bug
...
fix model type changed after calling .to() method
2023-08-31 19:04:02 +08:00
PanQiWei
c7021f0f44
fix model type changed after calling .to() method
2023-08-31 18:39:03 +08:00
qwopqwop200
45a1ee4d84
install check qigen
2023-08-31 14:37:39 +09:00
qwopqwop200
6a9d80eddc
Merge remote-tracking branch 'qwopqwop200/main' into main
2023-08-25 18:06:03 +09:00
Felix Marty
04730ac66c
expose api to set exllama max length
2023-08-24 11:22:15 +00:00
qwopqwop200
b8a42911a6
qigen refactoring
2023-08-17 15:22:16 +09:00
qwopqwop200
2c1afc2ad9
chang name make_quant_cpu to make_quant_qigen
2023-08-11 15:04:58 +09:00
qwopqwop200
aa5528cb10
use_cpu name change and default dtype change
2023-08-11 09:51:36 +09:00
qwopqwop200
7ba78af3ae
support cpu
2023-08-10 22:48:04 +09:00
PanQiWei
44c7a1a184
make exllama_kernels compilation as optional
2023-08-09 17:42:22 +08:00
qwopqwop200
dc5541e78a
static groups default value change
2023-08-08 14:11:39 +09:00
qwopqwop200
25972d65bf
support static_groups and fix bug
2023-08-07 16:27:48 +09:00
qwopqwop200
a1fd81c72d
if training disable exllama
2023-08-01 12:29:58 +09:00
Felix Marty
5660b22f28
fix bug quantization config loading
2023-07-31 14:28:37 +00:00
Felix Marty
38447262c0
fix fused attn
2023-07-31 13:46:32 +00:00
Felix Marty
179776bd1d
exllama kernel
2023-07-31 11:50:45 +00:00
PanQiWei
ff1f100ded
remove argument 'save_dir' in method from_quantized
2023-07-26 17:58:04 +08:00
潘其威(William)
bbc4a7c455
Merge pull request #208 from TheBloke/TB_Add_SafeTensors_Metadata
...
Add Safetensors metadata saving, with some values saved to each .safetensor file
2023-07-26 11:54:47 +08:00
TheBloke
2647c92743
safetensors_metadata: add conversion to str() for input metadata to avoid errors from save_safe. Warn if this results in keys being overwritten.
2023-07-25 21:14:21 +00:00
TheBloke
ee7d80945b
Add version to metadata using new value
2023-07-25 14:25:24 +00:00
TheBloke
eeaf5ebc53
Extend huggingface_hub features to AutoGPTQForCausalLM.from_pretrained() so models can be quantised from the hub including using a private token and revision/branch etc
2023-07-25 13:26:37 +00:00
TheBloke
c9124e3fc7
Fix revision and other huggingface_hub args for .from_quantized(), which were not being passed through
2023-07-25 12:48:33 +00:00
TheBloke
3f359fc778
Add support for Safetensors metadata
2023-07-25 11:30:39 +00:00
潘其威(William)
b4fdd8d264
Merge branch 'main' into peft_integration
2023-06-02 19:11:59 +08:00
PanQiWei
ec6603d0ab
support older version python
2023-05-31 22:11:16 +08:00
qwopqwop200
c381958a5f
add warning
2023-05-30 23:53:33 +09:00
潘其威(William)
defc96ff04
Merge pull request #91 from TheBloke/TheBloke_support-HF-download
...
Add support for HF Hub download, and `push_to_hub`
2023-05-30 07:37:15 +08:00
潘其威(William)
15db2cdc44
Update _base.py
...
fix problem that recursively adding file extension to model_base_name
2023-05-30 07:26:42 +08:00
潘其威(William)
cfa7271617
Update _base.py
...
fix variable not found error
2023-05-30 07:22:10 +08:00
潘其威(William)
e5771fb206
Update _base.py
...
fix key mismatch
2023-05-30 06:44:45 +08:00
潘其威(William)
ea74e15199
Update _base.py
...
add model_name_or_path and model_file_base_name to BaseQuantizeConfig for better model file management; add back save_dir to .from_quantized() for backward compatible
2023-05-30 06:40:31 +08:00
PanQiWei
86f060c74b
Merge branch 'main' into peft_integration
2023-05-28 16:23:38 +08:00
qwopqwop200
4d5b4fa5c6
add dtype
2023-05-27 07:49:28 +09:00
PanQiWei
f7e705848a
move peft compatible model injection to the last step
2023-05-26 14:29:33 +08:00
PanQiWei
2b532f9453
add trainable mode
2023-05-26 13:11:30 +08:00
PanQiWei
cfd27e8caa
refactor file structure of qlinears
2023-05-26 07:18:16 +08:00
PanQiWei
4d157a3b64
add hack of __getattr__
2023-05-25 15:10:33 +08:00
TheBloke
b7bb50b4d5
Fix bug added after merge
2023-05-25 07:05:51 +01:00
Tom Jobbins
492255b400
Merge branch 'main' into TheBloke_support-HF-download
2023-05-25 07:02:13 +01:00
PanQiWei
096749fe9d
generalize QuantLinear
2023-05-25 13:33:09 +08:00
PanQiWei
94ef4d5ada
update basic usage example code
2023-05-24 17:56:46 +08:00
PanQiWei
c89bb6450c
correct typo of function name
2023-05-24 17:43:38 +08:00
PanQiWei
10347fdd7b
remove full_cpu_offload argument and unify model dispatch strategy
2023-05-24 17:41:04 +08:00
