How to use model in GPT2-example
Hi,
I want to know how to use model when i complete GPT2-example, is there any sample or README?
screenshot as below:
i only fetch 3 sample data from IMDB.csv for testing.
After several test, i have several conclusions, sharing with you:
- use case
reader_0 for train
reader_1 for validate (as predict)
- save model
i add save_to_local_dir=True in TrainerParam, but it always save model.pkl, not adapter_config.json and adpater_model.bin, even though i add enable_save_pretrained = True on the top of gpt2.py
经过多次测试,我有几个结论,与大家分享:
- 使用案例 reader_0 训练 reader_1进行验证(如预测)
![]()
2.保存模型 我在TrainerParam中添加save_to_local_dir=True,但它总是保存model.pkl,而不是adapter_config.json和adpater_model.bin,即使我在gpt2.py顶部添加enable_save_pretrained = True
你好,请问能分享下这个任务的DSL和config吗?我尝试通过DSL配置来启动大模型任务
2.保存模型
我在TrainerParam中添加save_to_local_dir=True,但它总是保存model.pkl,而不是adapter_config.json和adpater_model.bin,即使我在gpt2.py顶部添加enable_save_pretrained = True