PanQiWei
|
c7021f0f44
|
fix model type changed after calling .to() method
|
2023-08-31 18:39:03 +08:00 |
|
PanQiWei
|
604c96144f
|
temporarily set the version of main branch to 0.5.0.dev0
|
2023-08-25 17:36:23 +08:00 |
|
潘其威(William)
|
e5050a5650
|
Revert "V0.4.2 release"
|
2023-08-25 17:26:55 +08:00 |
|
潘其威(William)
|
1049fd014a
|
Merge pull request #287 from PanQiWei/v0.4.2-release
V0.4.2 release
|
2023-08-25 17:26:41 +08:00 |
|
qwopqwop200
|
6a9d80eddc
|
Merge remote-tracking branch 'qwopqwop200/main' into main
|
2023-08-25 18:06:03 +09:00 |
|
qwopqwop200
|
dafdd6189a
|
duplicate code remove
|
2023-08-25 14:59:13 +09:00 |
|
Félix Marty
|
8254da4f15
|
update version
|
2023-08-24 17:47:14 +02:00 |
|
Felix Marty
|
04730ac66c
|
expose api to set exllama max length
|
2023-08-24 11:22:15 +00:00 |
|
qwopqwop200
|
f23a06f911
|
Merge branch 'PanQiWei:main' into main
|
2023-08-17 15:22:43 +09:00 |
|
qwopqwop200
|
b8a42911a6
|
qigen refactoring
|
2023-08-17 15:22:16 +09:00 |
|
qwopqwop200
|
5d5b687ca8
|
qigen formatting qlinear
|
2023-08-17 15:19:01 +09:00 |
|
qwopqwop200
|
084c9d8860
|
name change
|
2023-08-17 15:17:09 +09:00 |
|
PanQiWei
|
893fc5d7a3
|
release 0.4.1
|
2023-08-13 16:35:59 +08:00 |
|
PanQiWei
|
34b4ba451c
|
fix typo
|
2023-08-13 16:26:02 +08:00 |
|
qwopqwop200
|
051f3facc7
|
change arguments name
|
2023-08-11 16:10:32 +09:00 |
|
qwopqwop200
|
a807e038bb
|
remove many contiguous and change arguments name
|
2023-08-11 16:09:42 +09:00 |
|
qwopqwop200
|
c591d6a1e1
|
change name make_quant_cpu to make_quant_qigen
|
2023-08-11 15:12:33 +09:00 |
|
qwopqwop200
|
2c1afc2ad9
|
chang name make_quant_cpu to make_quant_qigen
|
2023-08-11 15:04:58 +09:00 |
|
qwopqwop200
|
aa5528cb10
|
use_cpu name change and default dtype change
|
2023-08-11 09:51:36 +09:00 |
|
qwopqwop200
|
870be83bea
|
Merge branch 'PanQiWei:main' into main
|
2023-08-10 22:48:30 +09:00 |
|
qwopqwop200
|
7ba78af3ae
|
support cpu
|
2023-08-10 22:48:04 +09:00 |
|
Felix Marty
|
4af7ea619d
|
patch for transformers compatiblity
|
2023-08-09 14:23:59 +00:00 |
|
PanQiWei
|
44c7a1a184
|
make exllama_kernels compilation as optional
|
2023-08-09 17:42:22 +08:00 |
|
PanQiWei
|
172deae049
|
expose disable_exllama argument
|
2023-08-09 12:03:31 +08:00 |
|
PanQiWei
|
86a3d4a094
|
release 0.4.0
|
2023-08-09 11:54:31 +08:00 |
|
qwopqwop200
|
fe244503e0
|
add ","
|
2023-08-08 19:57:23 +09:00 |
|
qwopqwop200
|
d22f89c524
|
support qwen
|
2023-08-08 19:27:43 +09:00 |
|
qwopqwop200
|
dc5541e78a
|
static groups default value change
|
2023-08-08 14:11:39 +09:00 |
|
qwopqwop200
|
2f48780165
|
fix bug disable exlllama
|
2023-08-07 16:28:30 +09:00 |
|
qwopqwop200
|
25972d65bf
|
support static_groups and fix bug
|
2023-08-07 16:27:48 +09:00 |
|
qwopqwop200
|
6233afce3b
|
support static_groups
|
2023-08-07 16:25:44 +09:00 |
|
fxmarty
|
71f23268eb
|
Merge pull request #1 from qwopqwop200/exllama-q4-kernel
Exllama q4 kernel
|
2023-08-05 00:15:22 +09:00 |
|
Felix Marty
|
d0608b09db
|
rocm support
|
2023-08-04 13:38:02 +00:00 |
|
Félix Marty
|
4fb3e20c5e
|
Merge branch 'main' into exllama-q4-kernel
|
2023-08-04 15:13:34 +02:00 |
|
潘其威(William)
|
5d8fa85029
|
Merge pull request #226 from LeiWang1999/fix/general_attr
Register quant params in GeneralQuantLinear for friendly post process.
|
2023-08-04 18:42:54 +08:00 |
|
潘其威(William)
|
45152b7add
|
Merge pull request #220 from fxmarty/fix-revison-loading
Fix revision used to load the quantization config
|
2023-08-04 18:25:22 +08:00 |
|
qwopqwop200
|
79ab5076c7
|
revert fused_llama_attn.py
|
2023-08-04 18:19:54 +09:00 |
|
qwopqwop200
|
068210d0b7
|
exllama support flash attention
|
2023-08-03 16:30:16 +09:00 |
|
qwopqwop200
|
7a7df5655a
|
support group query attention
|
2023-08-03 16:08:49 +09:00 |
|
leiwang1999
|
a0de5c2c51
|
regist buffer of general quant linear
|
2023-08-03 05:15:09 +00:00 |
|
qwopqwop200
|
3fc097dcd8
|
change pcak func support only 4 bit
|
2023-08-01 20:01:45 +09:00 |
|
qwopqwop200
|
a1fd81c72d
|
if training disable exllama
|
2023-08-01 12:29:58 +09:00 |
|
qwopqwop200
|
a60c9a8552
|
add pack fun
|
2023-08-01 12:22:41 +09:00 |
|
Felix Marty
|
339c57a902
|
fix
|
2023-07-31 15:57:44 +00:00 |
|
Felix Marty
|
129fa4b67e
|
act-order now works fine
|
2023-07-31 15:36:58 +00:00 |
|
Felix Marty
|
1f99b94ae2
|
fix revision
|
2023-07-31 15:03:33 +00:00 |
|
Felix Marty
|
5660b22f28
|
fix bug quantization config loading
|
2023-07-31 14:28:37 +00:00 |
|
Felix Marty
|
38447262c0
|
fix fused attn
|
2023-07-31 13:46:32 +00:00 |
|
Felix Marty
|
760667dccc
|
cleaning
|
2023-07-31 11:58:10 +00:00 |
|
Felix Marty
|
179776bd1d
|
exllama kernel
|
2023-07-31 11:50:45 +00:00 |
|