tiny icon indicating copy to clipboard operation
tiny copied to clipboard

Do you have any plans to use tensorflow or caffe to implement this paper?

Open zsz02 opened this issue 8 years ago • 24 comments

Your working is very nice !!! Do you have any plans to use tensorflow or caffe to implement this paper?

zsz02 avatar May 17 '17 13:05 zsz02

I do have a Caffe version that I may release later.

peiyunh avatar Jun 07 '17 17:06 peiyunh

I think caffe is not a good choice because the matconvnet has net.conserveMemory mechanism to aggressively conserve memory when inferencing a large upsampled image(5000x5000) while caffe have not any memory management schema. CNTK or mxnet may be a good choice as they gracefully support DAG memory sharing technology(same or not same to matconvnet's conserveMemory) to deal with the huge resnet101-fcn like model when processing large photo.

chinakook avatar Jun 09 '17 14:06 chinakook

@peiyunh I have already converted matconvnet model to caffemodel. But the problem is just like what @chinakook said, I can't test a image whose size is more than 1000 * 600, because of out of gpu memory. So please tell me how you solve the problem if you have any spare time. Thank you very much!

MaxLingwei avatar Jun 13 '17 08:06 MaxLingwei

@MaxLingwei I have ported a MXNet implementation which is high performant and momory efficiency as the peiyun's Matconvnet implementation. please refer to https://github.com/chinakook/hr101_mxnet

chinakook avatar Jun 14 '17 10:06 chinakook

@chinakook Thank you for your information. I just resized the img and got a good result as using its original size. And I can use caffe after resized it.

MaxLingwei avatar Jun 16 '17 11:06 MaxLingwei

@peiyunh It will be anticipated to see the caffe version

helxsz avatar Jun 20 '17 13:06 helxsz

Has anyone implemented a Tensorflow version ?

kunal10 avatar Jul 11 '17 17:07 kunal10

If you have implemented a Tensorflow version, do let me know!

peiyunh avatar Jul 24 '17 19:07 peiyunh

If someone wants to collaborate to implement it with Keras (TensorFlow backend), let me know ! I began to work on it but I don't know Matlab enough

alexattia avatar Jul 25 '17 19:07 alexattia

Can you commit a caffe version?

jmu201521121021 avatar Aug 01 '17 13:08 jmu201521121021

@jmu201521121021 @helxsz i have written a script which can transform a matconvnet model to cafemodel. https://github.com/MaxLingwei/MatConvNet2caffe

MaxLingwei avatar Aug 07 '17 07:08 MaxLingwei

@MaxLingwei Thanks, also like to know the caffe version

helxsz avatar Aug 13 '17 11:08 helxsz

hi @peiyunh appreciate ur nice work, very happy to see ur plan on releasing the version of caffe. I plan to realize ur tiny face on caffe framework, so it would be helpful to let me know when will you release it?

takecareofbigboss avatar Sep 06 '17 08:09 takecareofbigboss

Is it possible to have the caffe version?

fsalmasri avatar Sep 21 '17 15:09 fsalmasri

A newer face detection based on tiny face named SSH is open. https://github.com/mahyarnajibi/SSH

chinakook avatar Oct 17 '17 14:10 chinakook

@peiyunh @chinakook I have ported a TensorFlow Tiny Face Detector based on peiyunh's MatConvNet and chinakook's MXNet versions. Note my port supports only inference parts, not training. https://github.com/cydonia999/Tiny_Faces_in_Tensorflow

cydonia999 avatar Oct 17 '17 14:10 cydonia999

@cydonia999 nice work! I've already finished the MXNet version of tiny including training. I will make it public later and the data preparation code can be shared across different deep learning frameworks.

chinakook avatar Oct 18 '17 01:10 chinakook

@chinakook nice work SSH~ still waiting for the caffe version of tiny face.

takecareofbigboss avatar Oct 18 '17 08:10 takecareofbigboss

@MaxLingwei Thank you for your matconvnet2caffe. Do you compare the result between caffe and matconvnet? Is the result of caffe same with the matconvnet?

zmlmanly avatar Oct 19 '17 08:10 zmlmanly

@zmlmanly It's nearly the same. But there's another problem that caffe has no method for memory saving. It costs too much GPU memory. So I can't test on large images using caffe.

MaxLingwei avatar Oct 19 '17 14:10 MaxLingwei

@MaxLingwei Thank you for your reply. I think you can reduce the height and width of input_dim in prototxt, for example, you can adjust input_dim:1 input_dmi:3 input_dim:224 input_dim:224 to input_dim:1 input_dmi:3 input_dim:64 input_dim:64 I have no idea if the method is correct, you can try it. And I have a problem about your matconvnet2caffe, how to convert the ConvTranspose_Layer in matconvnet to caffe? In matconvnet, there is a "crop [1,2,1,2]" in ConvTranspose_Layer in hr_res101.mat, but there is no "crop" in Deconvolution_Layer in caffe. How to realize the "crop [1,2,1,2]" in caffe? Thank you very much.

zmlmanly avatar Oct 20 '17 01:10 zmlmanly

@zmlmanly I just use both the Deconvolution layer and Crop layer in caffe, adding the Crop layer after the Deconvolution layer.

MaxLingwei avatar Oct 29 '17 14:10 MaxLingwei

@MaxLingwei How to set the Crop layer after the Deconvolution layer in caffe? For example, the input of deconvolution layer is [N,C,H,W], the output of deconvolution layer in caffe is [N,C,2H,2W], but the output of deconvolution layer in matconvnet is [N,C,2H-1,2W-1]. Could you give me display the crop layer of prototxt in caffe? Thang you very much.

zmlmanly avatar Oct 31 '17 05:10 zmlmanly

@zmlmanly There are two bottoms in Crop layer. To my knowledge it will crop one bottom to match another automaticly. I have upload the prototxt in my repository. https://github.com/MaxLingwei/MatConvNet2caffe

MaxLingwei avatar Nov 07 '17 13:11 MaxLingwei