PanQiWei
|
950f203260
|
add 'n_positions' to sequence length search list
|
2023-04-27 01:09:10 +08:00 |
|
PanQiWei
|
893c3264cb
|
make layer ignorance more robust
|
2023-04-26 19:35:19 +08:00 |
|
PanQiWei
|
f2359f56cb
|
add support to use push_to_hub to upload and share quantized model
|
2023-04-26 16:55:01 +08:00 |
|
PanQiWei
|
975f100d0f
|
init Quantizer() at GPTQ() init stage
|
2023-04-25 23:13:09 +08:00 |
|
PanQiWei
|
062b34f31a
|
add inference_mode and autocast context manager to generate function
|
2023-04-25 20:47:33 +08:00 |
|
PanQiWei
|
31d683f85b
|
add option to choose whether autotune warmup or not after quantization
|
2023-04-25 20:29:05 +08:00 |
|
PanQiWei
|
9c405b1628
|
add triton support
|
2023-04-25 20:05:22 +08:00 |
|
PanQiWei
|
832dc4a7a1
|
refactor file structure
|
2023-04-25 18:58:20 +08:00 |
|
PanQiWei
|
419160b733
|
always trust remote code
|
2023-04-25 12:52:49 +08:00 |
|
PanQiWei
|
f748dad2e1
|
always trust remote code
|
2023-04-25 12:13:46 +08:00 |
|
PanQiWei
|
7d3a625cee
|
fix mismatch GPTNeoxForCausalLM's lm_head
|
2023-04-24 20:51:56 +08:00 |
|
PanQiWei
|
1a8c460262
|
fix problem that some models required more positional arguments in transformer layer's forward function
|
2023-04-24 14:46:21 +08:00 |
|
PanQiWei
|
37c0a80092
|
fix problem that some models can't get seqlen from model.config.max_position_embeddings
|
2023-04-24 14:24:00 +08:00 |
|
PanQiWei
|
4763c0b9a1
|
fix bugs
|
2023-04-23 19:27:16 +08:00 |
|
PanQiWei
|
a830a62bc3
|
fix bugs for attention_mask and position_ids
|
2023-04-20 18:32:21 +08:00 |
|
PanQiWei
|
bcc7e0a051
|
make BaseGPTQForCausalLM as nn.Module, add more shortcut apis and fix some bugs
|
2023-04-17 01:15:30 +08:00 |
|
PanQiWei
|
969ec250ad
|
add shortcut to model.to method
|
2023-04-17 00:34:14 +08:00 |
|
PanQiWei
|
12ae4d024c
|
fix gptj forward and add torch.no_grad context manager
|
2023-04-17 00:15:41 +08:00 |
|
PanQiWei
|
87402e01c9
|
fix some errors at quantized model loading
|
2023-04-16 22:32:13 +08:00 |
|
PanQiWei
|
036a151f10
|
fix save_dir not exist
|
2023-04-16 22:20:54 +08:00 |
|
PanQiWei
|
42b28f032f
|
shortcut model.config
|
2023-04-16 22:12:42 +08:00 |
|
PanQiWei
|
0c4b039925
|
add setup.py
|
2023-04-16 21:06:15 +08:00 |
|
PanQiWei
|
229b61e20e
|
first init
|
2023-04-14 01:09:40 +08:00 |
|