allen

Will we support pytorch SparseAdam optimizer ?

1

Seems horrovod currently not support sparse tensor. "L-BFGS is currently unsupported, as are sparse tensors, which are required by SparseAdam optimizer" Will support sparse tensor ?

Not find SWEM-hier

16

Hi, seems not find hier encoder as paper mentioned. Very interested to see it :)

Pytorch with tensorflow dataset, setting torch.cuda.set_device not work

1

pytorch 1.1.0, tensorflow 1.14.0, I'm using tensorflow dataset for data reading and feeding to pytorch model training process. When using horovod, however torch.cuda.set_device not work, not each process with 1...

Where is the code for "Pointing the Unknown Words"

2

Seems no code here, as the paper mentioned.

Build issue of ps-lite need #include <algorithm>

1

src/ps/shared_array.h: In member function 'ps::SArray ps::SArray::SetUnion(const ps::SArray&) const': src/ps/shared_array.h:208:15: error: 'set_union' is not a member of 'std' V\* last = std::set_union( ^ Need to add #include at src/ps/shared_array.h