qwopqwop200
|
8c7c806d36
|
if exllama auto diable fused attention
|
2023-08-07 19:24:16 +09:00 |
|
qwopqwop200
|
11afc47f7f
|
support gqa
|
2023-08-07 19:00:05 +09:00 |
|
qwopqwop200
|
2f48780165
|
fix bug disable exlllama
|
2023-08-07 16:28:30 +09:00 |
|
qwopqwop200
|
25972d65bf
|
support static_groups and fix bug
|
2023-08-07 16:27:48 +09:00 |
|
qwopqwop200
|
6233afce3b
|
support static_groups
|
2023-08-07 16:25:44 +09:00 |
|
PanQiWei
|
d427489911
|
update README
|
2023-08-06 20:03:33 +08:00 |
|
潘其威(William)
|
9e2741c99d
|
Merge pull request #219 from fxmarty/exllama-q4-kernel
Add exllama q4 kernel
|
2023-08-06 19:53:40 +08:00 |
|
fxmarty
|
71f23268eb
|
Merge pull request #1 from qwopqwop200/exllama-q4-kernel
Exllama q4 kernel
|
2023-08-05 00:15:22 +09:00 |
|
Felix Marty
|
c203a85dee
|
fix
|
2023-08-04 15:00:12 +00:00 |
|
Felix Marty
|
d0608b09db
|
rocm support
|
2023-08-04 13:38:02 +00:00 |
|
Félix Marty
|
4fb3e20c5e
|
Merge branch 'main' into exllama-q4-kernel
|
2023-08-04 15:13:34 +02:00 |
|
潘其威(William)
|
5d8fa85029
|
Merge pull request #226 from LeiWang1999/fix/general_attr
Register quant params in GeneralQuantLinear for friendly post process.
|
2023-08-04 18:42:54 +08:00 |
|
潘其威(William)
|
45152b7add
|
Merge pull request #220 from fxmarty/fix-revison-loading
Fix revision used to load the quantization config
|
2023-08-04 18:25:22 +08:00 |
|
潘其威(William)
|
63da0cd00a
|
Merge pull request #214 from fxmarty/rocm-support
Add RoCm support
|
2023-08-04 18:24:15 +08:00 |
|
潘其威(William)
|
e6790ba2cb
|
Update README.md
|
2023-08-04 18:16:55 +08:00 |
|
qwopqwop200
|
79ab5076c7
|
revert fused_llama_attn.py
|
2023-08-04 18:19:54 +09:00 |
|
qwopqwop200
|
068210d0b7
|
exllama support flash attention
|
2023-08-03 16:30:16 +09:00 |
|
qwopqwop200
|
7a7df5655a
|
support group query attention
|
2023-08-03 16:08:49 +09:00 |
|
leiwang1999
|
a0de5c2c51
|
regist buffer of general quant linear
|
2023-08-03 05:15:09 +00:00 |
|
qwopqwop200
|
3fc097dcd8
|
change pcak func support only 4 bit
|
2023-08-01 20:01:45 +09:00 |
|
qwopqwop200
|
a1fd81c72d
|
if training disable exllama
|
2023-08-01 12:29:58 +09:00 |
|
qwopqwop200
|
a60c9a8552
|
add pack fun
|
2023-08-01 12:22:41 +09:00 |
|
Felix Marty
|
7ce182888c
|
fix atol
|
2023-07-31 16:46:15 +00:00 |
|
Felix Marty
|
339c57a902
|
fix
|
2023-07-31 15:57:44 +00:00 |
|
Felix Marty
|
129fa4b67e
|
act-order now works fine
|
2023-07-31 15:36:58 +00:00 |
|
Felix Marty
|
1f99b94ae2
|
fix revision
|
2023-07-31 15:03:33 +00:00 |
|
Felix Marty
|
208bbfb419
|
fix test
|
2023-07-31 14:59:42 +00:00 |
|
Felix Marty
|
d595b0be06
|
add test act-order wip (not passing)
|
2023-07-31 14:29:19 +00:00 |
|
Felix Marty
|
5660b22f28
|
fix bug quantization config loading
|
2023-07-31 14:28:37 +00:00 |
|
Felix Marty
|
7c72b72d15
|
add test
|
2023-07-31 13:47:43 +00:00 |
|
Felix Marty
|
38447262c0
|
fix fused attn
|
2023-07-31 13:46:32 +00:00 |
|
Felix Marty
|
760667dccc
|
cleaning
|
2023-07-31 11:58:10 +00:00 |
|
Felix Marty
|
179776bd1d
|
exllama kernel
|
2023-07-31 11:50:45 +00:00 |
|
Felix Marty
|
23eb519e68
|
typo
|
2023-07-28 17:45:34 +00:00 |
|
Felix Marty
|
caf6625b68
|
warning about triton
|
2023-07-28 17:42:37 +00:00 |
|
Felix Marty
|
d20540173c
|
change repo owner back to PanQiWei
|
2023-07-28 16:43:58 +00:00 |
|
Felix Marty
|
121399f8e5
|
fix workflows
|
2023-07-28 16:42:39 +00:00 |
|
Felix Marty
|
677d23be2d
|
style
|
2023-07-28 15:14:46 +00:00 |
|
Felix Marty
|
8112239848
|
add workflow, edit readme & add tests
|
2023-07-28 15:10:39 +00:00 |
|
Felix Marty
|
2cb191e114
|
fix bugs
|
2023-07-28 14:10:44 +00:00 |
|
Felix Marty
|
547fb198d1
|
fix
|
2023-07-27 12:36:25 +00:00 |
|
Félix Marty
|
0b8a1f922d
|
is it as simple as that?
|
2023-07-27 12:14:33 +02:00 |
|
PanQiWei
|
a7167b108c
|
simplify setup.py
|
2023-07-26 19:18:05 +08:00 |
|
PanQiWei
|
6395e4b301
|
update setup.py
|
2023-07-26 18:58:49 +08:00 |
|
PanQiWei
|
d6b6ec83ef
|
Merge remote-tracking branch 'origin/main'
|
2023-07-26 18:41:01 +08:00 |
|
PanQiWei
|
1138240385
|
update version to 0.3.2
|
2023-07-26 18:40:44 +08:00 |
|
潘其威(William)
|
b0889e4dab
|
Merge pull request #212 from casperbh96/main
Fix build on non-CUDA machines after #206
|
2023-07-26 18:35:53 +08:00 |
|
Casper
|
c68b4492f6
|
Fix build on non-CUDA machines after #206
|
2023-07-26 12:21:58 +02:00 |
|
PanQiWei
|
ff1f100ded
|
remove argument 'save_dir' in method from_quantized
|
2023-07-26 17:58:04 +08:00 |
|
PanQiWei
|
722a621aaa
|
simplified code
|
2023-07-26 17:53:47 +08:00 |
|