Evarist
Evarist
Hi all, I worked with @rsdubtso on the package too. @soumith, you are right, we should've pointed we report timings for the fastest iteration. Though, if you use the same...
Just quick update. Recently we released technical preview of Multinode Caffe. The link: https://software.intel.com/en-us/articles/caffe-training-on-multi-node-distributed-memory-systems-based-on-intel-xeon-processor-e5 The results are shown for Alexnet. We use data parallelism (for the first half of the...
@ozabluda, I mean the algorithm in Multinode Caffe (underlying math) is the same as in Singlenode Caffe: Forward, Backward, SGD, the same parameters and so on. In particular it means...
@ozabluda, sorry, but i am not familiar with multi-GPU Caffe. I need to look at the codes. In Multinode Caffe for the first half of the net the parameter updates...
Please take a look at https://communities.intel.com/community/itpeernetwork/datastack/blog/2015/11/12/myth-busted-general-purpose-cpus-can-t-tackle-deep-neural-network-training-part-2 for more information on technical details of Intel Multinode Caffe tech-preview, which actually uses one weird trick... :) There is more on technical side....
Currently we have a limitation on jitted gemm post-processing kernel: it supports only _traditional_ bias, i.e. bias along N dimension only. Bias along any other dimension (MB or M), 2D...
@uu-praveeng, do you use static or dynamic linkage with oneDNN? Disclaimer: unfortunately, there is no standard way to disable library pieces. However, in case of the static linkage it could...
Hi @ppetrushkov, > You may want to check the head of rls-v1.2 Or maybe just `master`. Could you please also specify what system you use? I ran u8s8s32 gemm on...
Not yet. Same holds for Inner Product.
Seems like a (partial) duplication of #509.