Commit graph

308 commits

Author SHA1 Message Date
PanQiWei
c7021f0f44 fix model type changed after calling .to() method 2023-08-31 18:39:03 +08:00
PanQiWei
604c96144f temporarily set the version of main branch to 0.5.0.dev0 2023-08-25 17:36:23 +08:00
潘其威(William)
e5050a5650
Revert "V0.4.2 release" 2023-08-25 17:26:55 +08:00
潘其威(William)
1049fd014a
Merge pull request #287 from PanQiWei/v0.4.2-release
V0.4.2 release
2023-08-25 17:26:41 +08:00
qwopqwop200
6a9d80eddc Merge remote-tracking branch 'qwopqwop200/main' into main 2023-08-25 18:06:03 +09:00
qwopqwop200
dafdd6189a
duplicate code remove 2023-08-25 14:59:13 +09:00
Félix Marty
8254da4f15 update version 2023-08-24 17:47:14 +02:00
Felix Marty
04730ac66c expose api to set exllama max length 2023-08-24 11:22:15 +00:00
qwopqwop200
f23a06f911
Merge branch 'PanQiWei:main' into main 2023-08-17 15:22:43 +09:00
qwopqwop200
b8a42911a6
qigen refactoring 2023-08-17 15:22:16 +09:00
qwopqwop200
5d5b687ca8
qigen formatting qlinear 2023-08-17 15:19:01 +09:00
qwopqwop200
084c9d8860
name change 2023-08-17 15:17:09 +09:00
PanQiWei
893fc5d7a3 release 0.4.1 2023-08-13 16:35:59 +08:00
PanQiWei
34b4ba451c fix typo 2023-08-13 16:26:02 +08:00
qwopqwop200
051f3facc7
change arguments name 2023-08-11 16:10:32 +09:00
qwopqwop200
a807e038bb
remove many contiguous and change arguments name 2023-08-11 16:09:42 +09:00
qwopqwop200
c591d6a1e1
change name make_quant_cpu to make_quant_qigen 2023-08-11 15:12:33 +09:00
qwopqwop200
2c1afc2ad9
chang name make_quant_cpu to make_quant_qigen 2023-08-11 15:04:58 +09:00
qwopqwop200
aa5528cb10
use_cpu name change and default dtype change 2023-08-11 09:51:36 +09:00
qwopqwop200
870be83bea
Merge branch 'PanQiWei:main' into main 2023-08-10 22:48:30 +09:00
qwopqwop200
7ba78af3ae support cpu 2023-08-10 22:48:04 +09:00
Felix Marty
4af7ea619d patch for transformers compatiblity 2023-08-09 14:23:59 +00:00
PanQiWei
44c7a1a184 make exllama_kernels compilation as optional 2023-08-09 17:42:22 +08:00
PanQiWei
172deae049 expose disable_exllama argument 2023-08-09 12:03:31 +08:00
PanQiWei
86a3d4a094 release 0.4.0 2023-08-09 11:54:31 +08:00
qwopqwop200
fe244503e0
add "," 2023-08-08 19:57:23 +09:00
qwopqwop200
d22f89c524
support qwen 2023-08-08 19:27:43 +09:00
qwopqwop200
dc5541e78a
static groups default value change 2023-08-08 14:11:39 +09:00
qwopqwop200
2f48780165
fix bug disable exlllama 2023-08-07 16:28:30 +09:00
qwopqwop200
25972d65bf
support static_groups and fix bug 2023-08-07 16:27:48 +09:00
qwopqwop200
6233afce3b
support static_groups 2023-08-07 16:25:44 +09:00
fxmarty
71f23268eb
Merge pull request #1 from qwopqwop200/exllama-q4-kernel
Exllama q4 kernel
2023-08-05 00:15:22 +09:00
Felix Marty
d0608b09db rocm support 2023-08-04 13:38:02 +00:00
Félix Marty
4fb3e20c5e Merge branch 'main' into exllama-q4-kernel 2023-08-04 15:13:34 +02:00
潘其威(William)
5d8fa85029
Merge pull request #226 from LeiWang1999/fix/general_attr
Register quant params in GeneralQuantLinear for friendly post process.
2023-08-04 18:42:54 +08:00
潘其威(William)
45152b7add
Merge pull request #220 from fxmarty/fix-revison-loading
Fix revision used to load the quantization config
2023-08-04 18:25:22 +08:00
qwopqwop200
79ab5076c7
revert fused_llama_attn.py 2023-08-04 18:19:54 +09:00
qwopqwop200
068210d0b7
exllama support flash attention 2023-08-03 16:30:16 +09:00
qwopqwop200
7a7df5655a
support group query attention 2023-08-03 16:08:49 +09:00
leiwang1999
a0de5c2c51 regist buffer of general quant linear 2023-08-03 05:15:09 +00:00
qwopqwop200
3fc097dcd8
change pcak func support only 4 bit 2023-08-01 20:01:45 +09:00
qwopqwop200
a1fd81c72d
if training disable exllama 2023-08-01 12:29:58 +09:00
qwopqwop200
a60c9a8552
add pack fun 2023-08-01 12:22:41 +09:00
Felix Marty
339c57a902 fix 2023-07-31 15:57:44 +00:00
Felix Marty
129fa4b67e act-order now works fine 2023-07-31 15:36:58 +00:00
Felix Marty
1f99b94ae2 fix revision 2023-07-31 15:03:33 +00:00
Felix Marty
5660b22f28 fix bug quantization config loading 2023-07-31 14:28:37 +00:00
Felix Marty
38447262c0 fix fused attn 2023-07-31 13:46:32 +00:00
Felix Marty
760667dccc cleaning 2023-07-31 11:58:10 +00:00
Felix Marty
179776bd1d exllama kernel 2023-07-31 11:50:45 +00:00