layered-depth-refinement icon indicating copy to clipboard operation
layered-depth-refinement copied to clipboard

About training

Open jackchinor opened this issue 2 years ago • 1 comments

Hi, could you share some training source or tips? I want to add layered depth refinement to depth estimation task, but don't know how to start. Thanks

jackchinor avatar Jul 04 '23 06:07 jackchinor

Hi @jackchinor , you can use any depth dataset and train a backbone model for depth in/outpainting in a self-supervised way using any unpaired masks (randomly generated, segmentation masks, etc). Then during inference, the model can be applied twice by inverting the input mask, which should be a quasi-accurate mask that you'd like to use for refinement. Our approach is very general and should work with any backbone architecture and dataset. All necessary details are in the paper. Feel free to let me know if you have any other questions!

sooyekim avatar Dec 11 '23 01:12 sooyekim