FATE-LLM icon indicating copy to clipboard operation
FATE-LLM copied to clipboard

How to use model in GPT2-example

Open stone-wlg opened this issue 2 years ago • 2 comments

Hi, I want to know how to use model when i complete GPT2-example, is there any sample or README? screenshot as below: image i only fetch 3 sample data from IMDB.csv for testing. image

stone-wlg avatar Jul 12 '23 02:07 stone-wlg

After several test, i have several conclusions, sharing with you:

  1. use case reader_0 for train reader_1 for validate (as predict) image image
  2. save model

i add save_to_local_dir=True in TrainerParam, but it always save model.pkl, not adapter_config.json and adpater_model.bin, even though i add enable_save_pretrained = True on the top of gpt2.py

stone-wlg avatar Jul 17 '23 09:07 stone-wlg

经过多次测试,我有几个结论,与大家分享:

  1. 使用案例 reader_0 训练 reader_1进行验证(如预测)

图像 图像 2.保存模型 我在TrainerParam中添加save_to_local_dir=True,但它总是保存model.pkl,而不是adapter_config.json和adpater_model.bin,即使我在gpt2.py顶部添加enable_save_pretrained = True

你好,请问能分享下这个任务的DSL和config吗?我尝试通过DSL配置来启动大模型任务

portalll avatar Jan 22 '24 03:01 portalll