CodeGeeX icon indicating copy to clipboard operation
CodeGeeX copied to clipboard

scripts/finetune_codegeex.sh中的HOSTFILE是什么概念和DATA_PATH中的数据源有没有开源数据集

Open wangyang135 opened this issue 2 years ago • 2 comments

HOSTFILE="<path to hostfile (with node ip addresses per line)>"

HOSTFILE不太理解是什么意思

====== Parameters ======

DATA_PATH="<path with prefix where you put the data (e.g., XXX/data.13b.mmap/data)>"

这个数据源有没有开源数据集

wangyang135 avatar May 09 '23 02:05 wangyang135

HOSTFILE是多个机器节点?里面直接放IP地址?

wangyang135 avatar May 09 '23 03:05 wangyang135

HOSTFILE没有多个机器的话可以写localhost吧,运行之后提示的是Unable to find hostfile,will proceed with training with local resources only 但是那个DATA_PATH应该给什么格式的路径啊,比如json,csv这种可以么?

WeiranGou avatar Jul 27 '23 08:07 WeiranGou