node2vec-c icon indicating copy to clipboard operation
node2vec-c copied to clipboard

Segmentation fault (core dumped)

Open Lihengwannafly opened this issue 6 years ago • 3 comments

./node2vec -input /data/ECommAI/round1_b/user_item.bcsr -output embedding.bin -dim 64 I use this command, but the following error occurs:

nv: 985597, ne: 69327988
Segmentation fault (core dumped)

32GB memory

Lihengwannafly avatar Aug 26 '19 08:08 Lihengwannafly

Hi! It may be that there are more second-order degrees than the system can allocate. Can you make a quick check that deepwalk-c (from the other repository) runs on that data?

xgfs avatar Aug 26 '19 14:08 xgfs

Hi, I have the same problem with your node2vec implementation. deepwalk-c works just fine on the same dataset. Any idea what to do?

akastrin avatar Oct 21 '19 14:10 akastrin

Hi! Does it calculate the amount of memory needed for the second-order probability tables? Corresponding line: https://github.com/xgfs/node2vec-c/blob/master/node2vec.cpp#L403

If yes, it may be just the nature of node2vec: for graphs with large star-like patterns it requires cubic memory.

xgfs avatar Oct 21 '19 17:10 xgfs