mvdfusion icon indicating copy to clipboard operation
mvdfusion copied to clipboard

Doubts about depth scale of the provided GSO test data

Open YZsZY opened this issue 11 months ago • 2 comments

Hello author, according to the provided blender scripts, the original rescale should be [0,1]->[0.5,2.5], but I use the following code for the backprojection:

depth_img = depth_img * 2.0 + 0.5  # !
depth_img[depth_img == 2.5] = 0

There are some noticeable misalignment at the edges in the final projected pointcloud: Image

I follow the depth process in Syncdreamer and find its depth scale is [0.6,2.4]: https://github.com/liuyuan-pal/SyncDreamer/issues/50 With the Syncdreamer's rescale the projected pointcloud is better aligned: Image

I would like to ask if there is a problem with my findings, could it be that the training of mvdfusion is rescaled to [0.5,2.5] but the GSO used is rescaled to [0.6,2.4]?

YZsZY avatar Mar 01 '25 09:03 YZsZY

Here are more cases' comparison: Image Image Image Image Image Image

YZsZY avatar Mar 01 '25 09:03 YZsZY

Hi @YZsZY thanks for checking this out and posting the findings!

We don't have enough information to comment on your findings atm but one thing that is true is that MVD-Fusion is trained on Objaverse with [0.5, 2.5].

zhizdev avatar Mar 25 '25 20:03 zhizdev