Commit graph

3 commits

Author SHA1 Message Date
TheBloke
4617629f0c Support setting inject_fused_attention and inject_fused_mlp to False 2023-06-03 17:48:36 +01:00
PanQiWei
f703c9ac98 update generation_speed.py 2023-05-27 20:15:43 +08:00
PanQiWei
e8bd3c33c4 add generation speed benchmark example script 2023-05-27 19:16:42 +08:00