Commit graph

9 commits

Author SHA1 Message Date
PanQiWei
41564a48db make data_utils.py as global utils 2023-04-28 18:08:58 +08:00
PanQiWei
4763c0b9a1 fix bugs 2023-04-23 19:27:16 +08:00
PanQiWei
3af35a05f0 add text summarization eval task 2023-04-23 16:31:17 +08:00
PanQiWei
6850a1e5bf refactor file structure of utils 2023-04-23 16:11:54 +08:00
PanQiWei
07ede4c0e5 specifically using needed fields instead of dropping unused ones 2023-04-23 14:25:51 +08:00
PanQiWei
baaf044dd0 add sequence classification evaluation task 2023-04-23 14:25:51 +08:00
PanQiWei
110b6f57e2 force to merge_prompt_label in language modeling task 2023-04-23 14:25:51 +08:00
PanQiWei
c305496e36 add language modeling evaluation task 2023-04-23 14:25:51 +08:00
PanQiWei
15fc47e482 add utils for dataset and dataloader 2023-04-23 14:25:51 +08:00