nerfstudio icon indicating copy to clipboard operation
nerfstudio copied to clipboard

NeRFtoGSandBack

Open Siming-He opened this issue 1 year ago • 3 comments

It contains the updates to include NeRFtoGSandBack (https://arxiv.org/abs/2405.09717) in nerfstudio. Thanks for your time in advance!

Siming-He avatar May 19 '24 01:05 Siming-He

Can you update your branch with latest main?

maturk avatar May 19 '24 08:05 maturk

Interesting project But how to adjust conversion time from Nerf-SH to NerfGS? It seems the longer time for conversion, the result is way better

ichsan2895 avatar May 19 '24 10:05 ichsan2895

Interesting project But how to adjust conversion time from Nerf-SH to NerfGS? It seems the longer time for conversion, the result is way better

Thank you! In the video, 7s is the time to export NeRFGS directly from NeRF-SH. Then, we finetune the NeRFGS for 3s, 33s and 153s on training data for better results.

Siming-He avatar May 19 '24 13:05 Siming-He

Any reviewers yet? I am not the developers of Nerfstudio

ichsan2895 avatar May 23 '24 03:05 ichsan2895

@Siming-He, just one question. Does it make sense to report the "training for 3s, 33s, or 153s" since doesn't the finetuning and amount of seconds highly depend on your computer specs? I wonder if its more meaningful to report how many iterations you retrain or how many images are seen during re-training (since for example GS is trained per-image at a training iteration, so num iterations is equivalent to num of images seen).

maturk avatar May 24 '24 12:05 maturk

@Siming-He, just one question. Does it make sense to report the "training for 3s, 33s, or 153s" since doesn't the finetuning and amount of seconds highly depend on your computer specs? I wonder if its more meaningful to report how many iterations you retrain or how many images are seen during re-training (since for example GS is trained per-image at a training iteration, so num iterations is equivalent to num of images seen).

You are right. In the report, we mentioned that training 100, 1000, 5000 iterations is about 3s, 33s, or 153s on GeForce RTX 4090. I added the number of training iterations in the video. Thank you for pointing this out!

Siming-He avatar May 24 '24 17:05 Siming-He

Great, thanks @Siming-He for answering my questions. LGTM, if you update your branch I can merge it!

maturk avatar May 27 '24 10:05 maturk