Pix2NeRF icon indicating copy to clipboard operation
Pix2NeRF copied to clipboard

The new view is terrible, although reconstruction is good

Open BCL123456-BAL opened this issue 3 years ago • 3 comments

  1. Render novel views of the given image: the source image: 0

the new view: gif

the reconstruction: reconstruction

the hybrid optimization: gif grid

Does anyone know how to improve it

BCL123456-BAL avatar Mar 10 '23 02:03 BCL123456-BAL

Hello, I'm having the same problem as you. Even though I use the pre-trained model provided by the author, the resulting new perspective image is still very different from the input image. Have you solved this problem?

955999979 avatar Nov 02 '23 03:11 955999979

The image is cropped to conform to the cropping standard of the celebA dataset.

BCL123456-BAL avatar Nov 02 '23 15:11 BCL123456-BAL

The image is cropped to conform to the cropping standard of the celebA dataset.

Hello, I noticed that images in the img_align_celeba dataset are aligned and cropped.

1 1 376980869549081_1 669499285871014 1 565810188447282_1 970671999595223 1 769802481867977_1 6106234654332232

The above is the result of my testing using the pre trained model provided by the author. The face in the test image is centered, with a size of 128 * 128, but the generated image is still not very similar, and the eyes are always looking down. Is it a problem with the input image? I tested using images from the ffhq dataset(128*128) ,and found that the two individuals are similar and had normal eye angles,so it should not be a problem with image size. So what specific requirements do the input dataset need to meet? Looking forward to your reply, thank you!

955999979 avatar Nov 06 '23 01:11 955999979