Commit graph

67 commits

Author SHA1 Message Date
PanQiWei
9c405b1628 add triton support 2023-04-25 20:05:22 +08:00
PanQiWei
832dc4a7a1 refactor file structure 2023-04-25 18:58:20 +08:00
PanQiWei
419160b733 always trust remote code 2023-04-25 12:52:49 +08:00
PanQiWei
f748dad2e1 always trust remote code 2023-04-25 12:13:46 +08:00
PanQiWei
7d3a625cee fix mismatch GPTNeoxForCausalLM's lm_head 2023-04-24 20:51:56 +08:00
PanQiWei
1a8c460262 fix problem that some models required more positional arguments in transformer layer's forward function 2023-04-24 14:46:21 +08:00
PanQiWei
37c0a80092 fix problem that some models can't get seqlen from model.config.max_position_embeddings 2023-04-24 14:24:00 +08:00
PanQiWei
4763c0b9a1 fix bugs 2023-04-23 19:27:16 +08:00
PanQiWei
a830a62bc3 fix bugs for attention_mask and position_ids 2023-04-20 18:32:21 +08:00
PanQiWei
bcc7e0a051 make BaseGPTQForCausalLM as nn.Module, add more shortcut apis and fix some bugs 2023-04-17 01:15:30 +08:00
PanQiWei
969ec250ad add shortcut to model.to method 2023-04-17 00:34:14 +08:00
PanQiWei
12ae4d024c fix gptj forward and add torch.no_grad context manager 2023-04-17 00:15:41 +08:00
PanQiWei
87402e01c9 fix some errors at quantized model loading 2023-04-16 22:32:13 +08:00
PanQiWei
036a151f10 fix save_dir not exist 2023-04-16 22:20:54 +08:00
PanQiWei
42b28f032f shortcut model.config 2023-04-16 22:12:42 +08:00
PanQiWei
0c4b039925 add setup.py 2023-04-16 21:06:15 +08:00
PanQiWei
229b61e20e first init 2023-04-14 01:09:40 +08:00