panoptic-lifting
panoptic-lifting copied to clipboard
nihalsid
[CVPR23 Highlight] Implementation for Panoptic Lifting
Hello, I found that the metrics in the training script train_panopli_tensorf.py and the evaluation script evaluate.py are calculated differently. There is a big difference between the PQ, SQ, and RQ...
https://github.com/nihalsid/panoptic-lifting/blob/b8ad4f5941ed0158f365d2c19facc86fbae2061e/dataset/preprocessing/preprocess_hypersim.py#L420 I found the maximum depths of some scenes in Hypersim after multiplying 1000 are far larger than the maximum value of int16(32767). It is not adequate to use int16...
Hi @nihalsid, thank you for this amazing work. ## Issue 1. Ubuntu 22.04 might face issues with the current environment setup (`requirements.txt`) - as [cudatoolkit 11.3 is not available](https://developer.nvidia.com/cuda-11.3.0-download-archive?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu) for...
I downloaded replica dataset provided by [Semantic_Nerf](https://github.com/Harry-Zhi/semantic_nerf?tab=readme-ov-file). When I ran preprocess_replica.py, I got a missing mesh.ply file, that is files not provided in the downloaded dataset. Can you please share...
Why is it that when I run your model, the results of val_iou and val_pq are close to your experimental results, but the results of rs_val_iou and rs_val_pq vary significantly?
I want the final output to be a 3D scene with segmented objects. How can it be achieved?
Hi @nihalsid, When I tried to train a model for hypersim ai_001_008 on the data generated by myself, I got a little worse mIoU 0.681 than the model (mIoU: 0.693)...
Dear author: It's a very nice work to attract me! Could you provide some examples to utilize the forward_**delete**/forward_**extract** etc. in model/renderer/panopli_tensoRF_renderer.py ? I don't know how to init the...
Hi, thank you for sharing your greak work! I want to re-implement the PNF, but I found you have re-implement it. Can you share it for me?
HI, thank for sharing such an amazing work. I am trying your sample data, and I wonder how can I use Deletion, Duplication, Manipulation like the video on your project...
