Commit graph

204 commits

Author SHA1 Message Date
PanQiWei
374ce21066 release v0.1.0 2023-05-05 00:18:50 +08:00
PanQiWei
753c261388 update README.md 2023-05-05 00:15:33 +08:00
PanQiWei
d79aec7bd0 update README.md 2023-05-04 23:06:32 +08:00
PanQiWei
fe3456100c bug fix from commit 3c108d4232 2023-05-04 22:34:16 +08:00
PanQiWei
e4d476be16 update README.md 2023-05-04 22:17:38 +08:00
PanQiWei
6cba6e7123 reformat code 2023-05-04 22:16:08 +08:00
PanQiWei
1c6bb69fae fix attribute name error 2023-05-04 22:10:33 +08:00
潘其威(William)
771b650a7c
Merge pull request #38 from PanQiWei/faster-cuda-no-actorder
Faster cuda no actorder
2023-05-04 21:47:19 +08:00
qwopqwop200
d2f48e5311
bug fix 2023-05-02 20:36:53 +09:00
潘其威(William)
144bd80436
Merge pull request #39 from TheBloke/TheBloke_check_model_exists
Check that model_save_name exists before trying to load it, to avoid confusing checkpoint error
2023-05-01 19:55:24 +08:00
潘其威(William)
d612b0d2f4
Merge pull request #37 from PanQiWei/bug-fix
bug fix quantization demo
2023-05-01 19:36:43 +08:00
潘其威(William)
69bcdfbbf2
Merge pull request #40 from TheBloke/TheBloke_fix_typo
Fix typo: 'hole' -> 'whole'
2023-05-01 19:34:30 +08:00
TheBloke
593a0b28bb Fix typo: 'hole' -> 'whole' 2023-05-01 10:25:18 +01:00
TheBloke
60195ca5f2 Check that model_save_name exists before trying inference, to avoid confusing checkpoint error 2023-05-01 10:15:13 +01:00
qwopqwop200
f0f37c1fe7
fix bug 2023-05-01 18:09:39 +09:00
qwopqwop200
95e633a597
add old cuda 2023-05-01 13:05:14 +09:00
qwopqwop200
5a69e22a93
add qlinear_old 2023-05-01 13:04:47 +09:00
qwopqwop200
9dfcac8e26
add qlinear_old 2023-05-01 13:03:57 +09:00
qwopqwop200
a982d400fb
add old k matmul 2023-05-01 13:02:42 +09:00
qwopqwop200
64e8d93e31
add old vecquantKmatmul 2023-05-01 13:01:37 +09:00
qwopqwop200
d986a738e1
bug fix quantization demo 2023-05-01 08:03:11 +09:00
PanQiWei
e2c7cd4fb3 update README.md 2023-04-30 16:52:15 +08:00
PanQiWei
da6981ac38 add tutorial: advanced-model-loading-and-best-practice 2023-04-30 16:46:48 +08:00
PanQiWei
d8d77199e9 Merge remote-tracking branch 'origin/main' 2023-04-30 16:04:45 +08:00
PanQiWei
1749477bba update README.md 2023-04-30 16:04:30 +08:00
潘其威(William)
e3bc7f220f
Update README.md 2023-04-30 08:38:22 +08:00
PanQiWei
bc7a05b576 update README.md 2023-04-29 22:46:59 +08:00
PanQiWei
fa89cf4872 update README.md 2023-04-29 22:45:52 +08:00
PanQiWei
ff20acaafe add quick start tutorial 2023-04-29 22:31:42 +08:00
潘其威(William)
a535c5727b
Merge pull request #34 from PanQiWei/change-save-name
Change default quantized model save basename
2023-04-29 20:37:24 +08:00
潘其威(William)
5fa803334d
Merge branch 'main' into change-save-name 2023-04-29 20:36:45 +08:00
潘其威(William)
1a3748db2a
Merge pull request #33 from z80maniac/customize-params
Allow to load arbitrary quantized models
2023-04-29 20:35:41 +08:00
qwopqwop200
787909084f
fix bug 2023-04-29 19:08:34 +09:00
qwopqwop200
a2ef4b98db
change save the name 2023-04-29 18:20:46 +09:00
qwopqwop200
9317af6c40
change save name 2023-04-29 18:19:13 +09:00
qwopqwop200
605f345135
Update basic_usage_gpt_xl.py 2023-04-29 18:18:50 +09:00
qwopqwop200
eb5a27f48c
Update basic_usage_wikitext2.py 2023-04-29 18:18:35 +09:00
qwopqwop200
3b74c9758e
change save name 2023-04-29 18:18:21 +09:00
qwopqwop200
b5eb906ac9
change save name 2023-04-29 18:17:59 +09:00
qwopqwop200
05733ae482
change save the name 2023-04-29 18:17:33 +09:00
qwopqwop200
1792cd1111
change save the name 2023-04-29 18:16:48 +09:00
ZXED
24a371d14a
use the same Optional style as in other params 2023-04-29 09:52:11 +03:00
ZXED
c22770188d
allow user to set trust_remote_code flag manually 2023-04-29 09:52:11 +03:00
ZXED
b3f19a7ba7
support custom model name when loading the model 2023-04-29 09:52:11 +03:00
ZXED
ea8ab73343
support custom quantize_config when loading the model 2023-04-29 09:51:50 +03:00
PanQiWei
16d8dd200f remove non-parameters module from MOSSGPTQForCausalLM.outside_layer_modules 2023-04-29 10:58:29 +08:00
PanQiWei
d9e7363fa8 update README.md 2023-04-29 01:47:40 +08:00
PanQiWei
b490ab004e remove override of _resize_attention_mask for llama and opt 2023-04-28 23:08:42 +08:00
潘其威(William)
1d91fded6c
Merge pull request #31 from PanQiWei/add-raise-exception-and-gpt2-xl-example-add
Add example to use with GPT2-XL and raise an error when infeature and outfeature are not be divisible by 256
2023-04-28 22:52:18 +08:00
qwopqwop200
ae8b1a22a3
change global to local 2023-04-28 23:18:39 +09:00