Commit graph

111 commits

Author SHA1 Message Date
PanQiWei
37c0a80092 fix problem that some models can't get seqlen from model.config.max_position_embeddings 2023-04-24 14:24:00 +08:00
PanQiWei
4763c0b9a1 fix bugs 2023-04-23 19:27:16 +08:00
PanQiWei
a830a62bc3 fix bugs for attention_mask and position_ids 2023-04-20 18:32:21 +08:00
PanQiWei
bcc7e0a051 make BaseGPTQForCausalLM as nn.Module, add more shortcut apis and fix some bugs 2023-04-17 01:15:30 +08:00
PanQiWei
969ec250ad add shortcut to model.to method 2023-04-17 00:34:14 +08:00
PanQiWei
12ae4d024c fix gptj forward and add torch.no_grad context manager 2023-04-17 00:15:41 +08:00
PanQiWei
87402e01c9 fix some errors at quantized model loading 2023-04-16 22:32:13 +08:00
PanQiWei
036a151f10 fix save_dir not exist 2023-04-16 22:20:54 +08:00
PanQiWei
42b28f032f shortcut model.config 2023-04-16 22:12:42 +08:00
PanQiWei
0c4b039925 add setup.py 2023-04-16 21:06:15 +08:00
PanQiWei
229b61e20e first init 2023-04-14 01:09:40 +08:00