nerf icon indicating copy to clipboard operation
nerf copied to clipboard

Why the batch of the camera rays is sampled randomly?

Open slulura opened this issue 4 years ago • 2 comments

Would it benefit to use some form of patch sampling in order to include convolutional blocks?

slulura avatar Sep 27 '21 12:09 slulura

hi there, I think it might be helpful to use patching if u wanna calculate the loss in terms of the semantical meaning (i.e., style loss) instead of MSE. FYI, I am implementing a patch-based optimization scheme for NeRF, and the loss is calculated per patches instead of random rays across all images.

songrise avatar Jun 15 '22 09:06 songrise

@songrise hey, I also implement a patch-sampling-based optimization scheme. For example, N_rand=1024, so I sample a 32x32 patch in each training iteration. But I found the rgbloss was so unstable. It seems that the url you provied has been invalid, I wonder what's your implementation and whether it works.

elenacliu avatar Aug 05 '23 16:08 elenacliu