Commit graph

95 commits

Author SHA1 Message Date
PanQiWei
73cb1dbf09 optimize import and format code 2023-04-26 13:08:47 +08:00
PanQiWei
c6dee93f5d update README.md 2023-04-26 13:01:07 +08:00
PanQiWei
9a7e4430f8 update setup.py 2023-04-26 12:58:07 +08:00
PanQiWei
975f100d0f init Quantizer() at GPTQ() init stage 2023-04-25 23:13:09 +08:00
PanQiWei
c35dce525e format code 2023-04-25 22:58:52 +08:00
PanQiWei
9f7f44146f format code 2023-04-25 22:45:27 +08:00
PanQiWei
b71211b4c3 format code 2023-04-25 22:36:28 +08:00
PanQiWei
b7b0eee0cc release v0.0.4 2023-04-25 21:35:31 +08:00
PanQiWei
062b34f31a add inference_mode and autocast context manager to generate function 2023-04-25 20:47:33 +08:00
PanQiWei
7915278e5f bug fix 2023-04-25 20:43:40 +08:00
PanQiWei
8f93e97137 update example code 2023-04-25 20:41:27 +08:00
PanQiWei
31d683f85b add option to choose whether autotune warmup or not after quantization 2023-04-25 20:29:05 +08:00
PanQiWei
7ce3659451 release v0.0.4 2023-04-25 20:24:32 +08:00
PanQiWei
0a7ee423b8 update example code 2023-04-25 20:24:00 +08:00
PanQiWei
c6af495da2 add --use_triton flag 2023-04-25 20:23:52 +08:00
PanQiWei
8183f6cde5 update README.md 2023-04-25 20:20:06 +08:00
PanQiWei
eeec304de5 update README.md 2023-04-25 20:12:19 +08:00
PanQiWei
9c405b1628 add triton support 2023-04-25 20:05:22 +08:00
PanQiWei
d69eb227e6 update setup.py 2023-04-25 19:35:35 +08:00
PanQiWei
832dc4a7a1 refactor file structure 2023-04-25 18:58:20 +08:00
PanQiWei
0bb84053a2 update setup.py 2023-04-25 18:50:21 +08:00
PanQiWei
419160b733 always trust remote code 2023-04-25 12:52:49 +08:00
PanQiWei
cfcba7d116 update README.md 2023-04-25 12:34:04 +08:00
PanQiWei
d78685aade update README.md 2023-04-25 12:31:00 +08:00
PanQiWei
262416e7ff set package version to v0.0.4-dev 2023-04-25 12:16:05 +08:00
PanQiWei
6b6dd3e1e3 always trust remote code 2023-04-25 12:15:32 +08:00
PanQiWei
f748dad2e1 always trust remote code 2023-04-25 12:13:46 +08:00
PanQiWei
a259fb06bb add support to MOSS model 2023-04-25 11:54:29 +08:00
PanQiWei
73606a3a16 release v0.0.3 2023-04-25 01:09:30 +08:00
PanQiWei
7d3a625cee fix mismatch GPTNeoxForCausalLM's lm_head 2023-04-24 20:51:56 +08:00
PanQiWei
1a8c460262 fix problem that some models required more positional arguments in transformer layer's forward function 2023-04-24 14:46:21 +08:00
PanQiWei
5657bd2db7 set package version to v0.0.3-dev 2023-04-24 14:24:52 +08:00
PanQiWei
8b487af045 Merge remote-tracking branch 'origin/main' 2023-04-24 14:24:28 +08:00
PanQiWei
37c0a80092 fix problem that some models can't get seqlen from model.config.max_position_embeddings 2023-04-24 14:24:00 +08:00
潘其威(William)
9279602cea
fix typo 2023-04-24 13:49:39 +08:00
潘其威(William)
a19f58a870
Merge pull request #10 from eltociear/patch-1
Update README.md
2023-04-24 10:14:12 +08:00
Ikko Eltociear Ashimine
cad46eec02
Update README.md
huggingface -> Hugging Face
2023-04-24 02:22:56 +09:00
潘其威(William)
4f84d21684
Merge pull request #5 from PanQiWei/evaluation_and_benchmark
[WIP]Evaluation and benchmark
2023-04-23 20:03:00 +08:00
PanQiWei
4d3795b3a5 upgrade package version to v0.0.2 2023-04-23 20:02:35 +08:00
PanQiWei
254d23f5d4 update README.md 2023-04-23 20:02:16 +08:00
PanQiWei
3e074e6ea2 update README.md 2023-04-23 19:39:30 +08:00
PanQiWei
4b506f3dd4 add examples to use eval_tasks module 2023-04-23 19:30:46 +08:00
PanQiWei
1dc723dac5 refactor examples file structure 2023-04-23 19:30:11 +08:00
PanQiWei
4763c0b9a1 fix bugs 2023-04-23 19:27:16 +08:00
PanQiWei
7ba0edffe0 refactor file structure of modeling module 2023-04-23 17:33:09 +08:00
PanQiWei
3af35a05f0 add text summarization eval task 2023-04-23 16:31:17 +08:00
PanQiWei
6850a1e5bf refactor file structure of utils 2023-04-23 16:11:54 +08:00
PanQiWei
f5352fac1b Merge remote-tracking branch 'origin/evaluation_and_benchmark' into evaluation_and_benchmark 2023-04-23 14:26:09 +08:00
PanQiWei
07ede4c0e5 specifically using needed fields instead of dropping unused ones 2023-04-23 14:25:51 +08:00
PanQiWei
687f6272e0 update setup.py 2023-04-23 14:25:51 +08:00