qwopqwop200
|
c359f672a8
|
support faster and model load strict
|
2023-05-04 09:04:07 +09:00 |
|
qwopqwop200
|
afe1323b3f
|
support faster and model load strict
|
2023-05-04 09:03:36 +09:00 |
|
qwopqwop200
|
a88cd16d65
|
fix bug
|
2023-05-03 22:36:14 +09:00 |
|
qwopqwop200
|
24251d1397
|
check kwargs
|
2023-05-02 22:32:54 +09:00 |
|
qwopqwop200
|
26581b6946
|
remove LlamaGPTQForCausalLM
|
2023-05-02 22:18:17 +09:00 |
|
qwopqwop200
|
694f2954a3
|
add auto model parameter
|
2023-05-02 22:16:23 +09:00 |
|
qwopqwop200
|
ccd87e5800
|
add Auto model parameter
|
2023-05-02 22:15:56 +09:00 |
|
qwopqwop200
|
d8707f92a9
|
support fused_attn
|
2023-05-02 21:54:15 +09:00 |
|
qwopqwop200
|
61c6f6a5d2
|
typo fix
|
2023-05-02 21:53:39 +09:00 |
|
qwopqwop200
|
a11d59f6c4
|
support fused_attn
|
2023-05-02 21:53:13 +09:00 |
|
qwopqwop200
|
f47322f073
|
fix bug
|
2023-05-02 21:14:27 +09:00 |
|
qwopqwop200
|
41f2379850
|
bug fix
|
2023-05-02 20:38:17 +09:00 |
|
qwopqwop200
|
d2f48e5311
|
bug fix
|
2023-05-02 20:36:53 +09:00 |
|
qwopqwop200
|
709bd7594f
|
Merge pull request #44 from PanQiWei/fix-bug-cuda
Fix bug cuda
|
2023-05-02 19:50:59 +09:00 |
|
qwopqwop200
|
9490a98444
|
add LlamaGPTQForCausalLM
|
2023-05-02 19:32:18 +09:00 |
|
qwopqwop200
|
a6d4f5c091
|
fix bug
|
2023-05-02 19:19:04 +09:00 |
|
qwopqwop200
|
2ba84fbb48
|
fix bug
|
2023-05-02 19:13:40 +09:00 |
|
qwopqwop200
|
1388acac94
|
fix bug
|
2023-05-02 19:13:13 +09:00 |
|
qwopqwop200
|
6c23e5b3a5
|
add fused mlp ,fused attn
|
2023-05-02 18:55:44 +09:00 |
|
qwopqwop200
|
f51f763fde
|
fused attn ,fused mlp apply
|
2023-05-02 18:51:04 +09:00 |
|
qwopqwop200
|
50c0fd13c5
|
Multi-GPU, allocate output tensor
|
2023-05-02 17:51:41 +09:00 |
|
qwopqwop200
|
3c108d4232
|
fix bug
|
2023-05-02 12:00:50 +09:00 |
|
潘其威(William)
|
144bd80436
|
Merge pull request #39 from TheBloke/TheBloke_check_model_exists
Check that model_save_name exists before trying to load it, to avoid confusing checkpoint error
|
2023-05-01 19:55:24 +08:00 |
|
潘其威(William)
|
d612b0d2f4
|
Merge pull request #37 from PanQiWei/bug-fix
bug fix quantization demo
|
2023-05-01 19:36:43 +08:00 |
|
潘其威(William)
|
69bcdfbbf2
|
Merge pull request #40 from TheBloke/TheBloke_fix_typo
Fix typo: 'hole' -> 'whole'
|
2023-05-01 19:34:30 +08:00 |
|
TheBloke
|
593a0b28bb
|
Fix typo: 'hole' -> 'whole'
|
2023-05-01 10:25:18 +01:00 |
|
TheBloke
|
60195ca5f2
|
Check that model_save_name exists before trying inference, to avoid confusing checkpoint error
|
2023-05-01 10:15:13 +01:00 |
|
qwopqwop200
|
f0f37c1fe7
|
fix bug
|
2023-05-01 18:09:39 +09:00 |
|
qwopqwop200
|
95e633a597
|
add old cuda
|
2023-05-01 13:05:14 +09:00 |
|
qwopqwop200
|
5a69e22a93
|
add qlinear_old
|
2023-05-01 13:04:47 +09:00 |
|
qwopqwop200
|
9dfcac8e26
|
add qlinear_old
|
2023-05-01 13:03:57 +09:00 |
|
qwopqwop200
|
a982d400fb
|
add old k matmul
|
2023-05-01 13:02:42 +09:00 |
|
qwopqwop200
|
64e8d93e31
|
add old vecquantKmatmul
|
2023-05-01 13:01:37 +09:00 |
|
qwopqwop200
|
d986a738e1
|
bug fix quantization demo
|
2023-05-01 08:03:11 +09:00 |
|
PanQiWei
|
e2c7cd4fb3
|
update README.md
|
2023-04-30 16:52:15 +08:00 |
|
PanQiWei
|
da6981ac38
|
add tutorial: advanced-model-loading-and-best-practice
|
2023-04-30 16:46:48 +08:00 |
|
PanQiWei
|
d8d77199e9
|
Merge remote-tracking branch 'origin/main'
|
2023-04-30 16:04:45 +08:00 |
|
PanQiWei
|
1749477bba
|
update README.md
|
2023-04-30 16:04:30 +08:00 |
|
潘其威(William)
|
e3bc7f220f
|
Update README.md
|
2023-04-30 08:38:22 +08:00 |
|
PanQiWei
|
bc7a05b576
|
update README.md
|
2023-04-29 22:46:59 +08:00 |
|
PanQiWei
|
fa89cf4872
|
update README.md
|
2023-04-29 22:45:52 +08:00 |
|
PanQiWei
|
ff20acaafe
|
add quick start tutorial
|
2023-04-29 22:31:42 +08:00 |
|
潘其威(William)
|
a535c5727b
|
Merge pull request #34 from PanQiWei/change-save-name
Change default quantized model save basename
|
2023-04-29 20:37:24 +08:00 |
|
潘其威(William)
|
5fa803334d
|
Merge branch 'main' into change-save-name
|
2023-04-29 20:36:45 +08:00 |
|
潘其威(William)
|
1a3748db2a
|
Merge pull request #33 from z80maniac/customize-params
Allow to load arbitrary quantized models
|
2023-04-29 20:35:41 +08:00 |
|
qwopqwop200
|
787909084f
|
fix bug
|
2023-04-29 19:08:34 +09:00 |
|
qwopqwop200
|
a2ef4b98db
|
change save the name
|
2023-04-29 18:20:46 +09:00 |
|
qwopqwop200
|
9317af6c40
|
change save name
|
2023-04-29 18:19:13 +09:00 |
|
qwopqwop200
|
605f345135
|
Update basic_usage_gpt_xl.py
|
2023-04-29 18:18:50 +09:00 |
|
qwopqwop200
|
eb5a27f48c
|
Update basic_usage_wikitext2.py
|
2023-04-29 18:18:35 +09:00 |
|