dynibar icon indicating copy to clipboard operation
dynibar copied to clipboard

Evaluation metrics: LPIPS,SSIM,PSNR

Open xiaoyudanaa opened this issue 2 years ago • 5 comments

Many congratulations on such an excellent article, I had some problems reproducing the results. I have experimented with the training weights you posted on the jumping dataset, but the final result is very poor as shown in the figure below, I would like to ask what causes this? I look forward to your reply. (The original set chunk size=8192, but the GPU could not run due to out-of-memory problem, so I set the chunk size to the same 1024 as NSFF) image

xiaoyudanaa avatar Jul 05 '23 23:07 xiaoyudanaa

Did you correctly load the model? This is usually due to the fact that you point to the incorrect model path.

zhengqili avatar Jul 06 '23 00:07 zhengqili

Based on your response, I checked my configuration path and its doesn't seem to be wrong. The details are shown in the attached image: image image

xiaoyudanaa avatar Jul 07 '23 01:07 xiaoyudanaa

When you run the script, from the terminal did you see something like "Reloading from xxxx, starting at step=yyyy" or "No ckpts found, training from scratch..."?

zhengqili avatar Jul 09 '23 21:07 zhengqili

Hi, I'm not the author of the paper. But I ran into a similar issue as you. In ibrnet/model.py line 104: out_folder = os.path.join(args.rootdir, 'checkpoints/fine', args.expname)

The "fine" model checkpoint location is at a hard-coded location relative to the root directory. So if you are correctly pointing to the coarse checkpoint location in the config file, you might still be running to this problem.

adamInThe80s avatar Jul 11 '23 13:07 adamInThe80s

Hello @xiaoyudanaa, do you have any summary of per-scene results on nvidia dataset?

quan5609 avatar Jan 18 '24 12:01 quan5609