4 commits

Author	SHA1	Message	Date
PanQiWei	b490ab004e	remove override of _resize_attention_mask for llama and opt	2023-04-28 23:08:42 +08:00
PanQiWei	a2abff983e	support dispatch layers to different devices when loading pretrained model before quantization	2023-04-27 02:24:08 +08:00
PanQiWei	a830a62bc3	fix bugs for attention_mask and position_ids	2023-04-20 18:32:21 +08:00
PanQiWei	229b61e20e	first init	2023-04-14 01:09:40 +08:00