Alicevision Meshroom support for custom data format and reusable for gsplat as well?

[jingyangcarl]

Is your feature request related to a problem? Please describe. I'm running the SFM pipeline from Alicevision Meshroom, but I don't find a supporting np-process-data pipeline explicitly handle the Meshroom output. I searched issues and PR with "Meshroom" keywords and got nothing found. Since Meshroom is not a very poor quality calibration+reconstruction software.

Also, the new repo gsplat has the example processing COLMAP format. Will this np-process-data pipeline become reusable for both repos?

Describe the solution you'd like I verified Meshroom output in Blender including the camera extrinsic and intrinsics as well as the mesh location

Describe alternatives you've considered manually have a code to convert the output from Meshroom to the nerfstudio is not difficult but could be integrated to the data preprocessing pipeline.

[jingyangcarl]

Also, COLMAP originally not supprot exr images https://github.com/colmap/colmap/issues/1584 I also found a similar issue https://github.com/nerfstudio-project/nerfstudio/issues/1097

[isolin]

mr2nerf works great for me.

1. First try it following the instructions, verify on a small model that it runs without errors.

2. It is better to start from an approximate solution, not from a random cloud. If you want splatfacto to place the initial splats on the positions of the landmarks reconstructed by Meshroom, then make sure to export a .ply the same was as the .json and add "ply_file_path": "path_to_your_exported.ply", to the transforms.json.

[parodiniccolo]

Maybe a bit late, but you can check this PR I've made.

https://github.com/nerfstudio-project/nerfstudio/pull/3646