wormhole icon indicating copy to clipboard operation
wormhole copied to clipboard

example '' ../learn/tool/text2crb train.txt data/train criteo 300" failed

Open andyyuan78 opened this issue 10 years ago • 2 comments

ubgpu@ubgpu:~/github/DMLC/wormhole/data$ ll ../learn/tool total 9732 drwxrwxr-x 2 ubgpu ubgpu 4096 8月 22 01:30 ./ drwxrwxr-x 12 ubgpu ubgpu 4096 8月 21 22:19 ../ -rwxrwxr-x 1 ubgpu ubgpu 3275903 8月 21 22:22 convert* -rw-rw-r-- 1 ubgpu ubgpu 3293 8月 21 22:19 convert.cc -rw-rw-r-- 1 ubgpu ubgpu 1737 8月 21 22:22 convert.d -rw-rw-r-- 1 ubgpu ubgpu 1746584 8月 21 22:22 convert.o -rw-rw-r-- 1 ubgpu ubgpu 9 8月 21 22:19 .gitignore -rw-rw-r-- 1 ubgpu ubgpu 805 8月 21 22:19 Makefile -rwxrwxr-x 1 ubgpu ubgpu 3241724 8月 22 01:30 text2crb* -rw-rw-r-- 1 ubgpu ubgpu 2456 8月 21 22:19 text2crb.cc -rw-rw-r-- 1 ubgpu ubgpu 1541 8月 22 01:30 text2crb.d -rw-rw-r-- 1 ubgpu ubgpu 1661216 8月 22 01:30 text2crb.o ubgpu@ubgpu:~/github/DMLC/wormhole/data$ ../learn/tool/text2crb train.txt data/train criteo 300 F0822 01:32:35.664461 21683 local_filesys.cc:150] Check failed: allow_null LocalFileSystem: fail to open data/train-part_00 *** Check failure stack trace: *** @ 0x4218ea google::LogMessage::Fail() @ 0x42381f google::LogMessage::SendToLog() @ 0x4214cf google::LogMessage::Flush() @ 0x42415e google::LogMessageFatal::~LogMessageFatal() @ 0x41bc8e dmlc::io::LocalFileSystem::Open() @ 0x410ce4 dmlc::Stream::Create() @ 0x4054a4 main @ 0x7f5f9e1fcec5 __libc_start_main @ 0x4071b6 (unknown) Aborted (core dumped) ubgpu@ubgpu:~/github/DMLC/wormhole/data$ ubgpu@ubgpu:~/github/DMLC/wormhole/data$ ll total 12311968 drwxrwxr-x 2 ubgpu ubgpu 4096 8月 21 23:29 ./ drwxrwxr-x 10 ubgpu ubgpu 4096 8月 22 00:50 ../ -rw-rw-r-- 1 ubgpu ubgpu 0 8月 21 23:29 put_dac.tar.gz_in_big_data -rw-r--r-- 1 ubgpu ubgpu 1927 8月 22 2014 readme.txt -rw-r--r-- 1 ubgpu ubgpu 1460246311 8月 22 2014 test.txt -rw-r--r-- 1 ubgpu ubgpu 11147184845 5月 12 2014 train.txt ubgpu@ubgpu:~/github/DMLC/wormhole/data$

andyyuan78 avatar Aug 22 '15 12:08 andyyuan78

please use the following command

wormhole/bin/convert.dmlc -data_in train.txt -format_in criteo -data_out data/train -format_out libsvm -part_size 300

mli avatar Aug 24 '15 13:08 mli

shoud be:

ubgpu@ubgpu:~/github/DMLC/wormhole$ bin/convert.dmlc -data_in data/train.txt -format_in criteo -data_out data/train -format_out libsvm -part_size 300

andyyuan78 avatar Aug 25 '15 02:08 andyyuan78