PeRF icon indicating copy to clipboard operation
PeRF copied to clipboard

Undesirable result on example image

Open ZiYang-xie opened this issue 2 years ago • 3 comments

Hi, thanks for the great work.

I have trained the model with the example panorama image kitchen you provided. However the result seems pretty bad. Looks like the depth estimation or the inpainting model failed to some extend. Do you have any clue of this issue?

Input Image

image

Reconstruction Result

https://github.com/perf-project/PeRF/assets/59246000/aa315054-89b9-4638-9ee8-632652f5cf16

ZiYang-xie avatar Nov 01 '23 15:11 ZiYang-xie

Most part of the pointcloud reconstructed from the monocular depth estimator looks good to me. However, I think it might be challenge for the inpainting model to restore the occluded area behind the kitchen island?

ZiYang-xie avatar Nov 01 '23 15:11 ZiYang-xie

BTW, The fridge looks normal in the pointcloud but why it seems to be distorted in reconstruction views?

ZiYang-xie avatar Nov 01 '23 15:11 ZiYang-xie

How did I get the pointcloud, was it generated by PeRF or did you process it yourself, I need the pointcloud

Only-Wion avatar Sep 23 '24 10:09 Only-Wion