nerfstudio icon indicating copy to clipboard operation
nerfstudio copied to clipboard

Add Zip-Nerf

Open MohamedAliRashad opened this issue 2 years ago • 7 comments

Google has released the code of Zip-Nerf here: https://jonbarron.info/zipnerf/

MohamedAliRashad avatar Jan 20 '24 22:01 MohamedAliRashad

@MohamedAliRashad it is usually pretty hard reimplementing papers, see how long gsplat took xD

maturk avatar Jan 20 '24 22:01 maturk

@maturk I don't think reimplementation will be required because they released the codes.

MohamedAliRashad avatar Jan 20 '24 22:01 MohamedAliRashad

There is a branch in nerfstudio that has tried to implement the full zip-nerf algorithm here. This was before the code release a few months ago. I am not sure if it will be updated now that the code is public.

maturk avatar Jan 20 '24 22:01 maturk

@maturk The link in the project directs to a repo created two days ago: https://github.com/jonbarron/camp_zipnerf

Maybe its a new (simpler) code.

MohamedAliRashad avatar Jan 20 '24 23:01 MohamedAliRashad

It would be worthwhile to put a thin wrapper around camp_zipnerf and create a method external to nerfstudio following https://github.com/nerfstudio-project/nerfstudio-method-template

So for anyone who might be interested in trying camp_zipnerf in the same framework as nerfstudio, it is easier.

jb-ye avatar Jan 20 '24 23:01 jb-ye

I want that be implemented too, but I don't understand coding which is too technical.

BTW, Imagine, we have ns-process-data camp for better result instead of ns-processed-data images. ns-train splatfacto with --load-3D-points=True itself is already good. What happen if we use it with Camp?

ichsan2895 avatar Jan 21 '24 14:01 ichsan2895

Jon says CamP’s poses can be exported, meaning that portion could be easy to plug in.

mikepayne02 avatar Jan 23 '24 03:01 mikepayne02

https://docs.nerf.studio/nerfology/methods/zipnerf.html

jb-ye avatar Mar 30 '24 04:03 jb-ye