com.unity.perception icon indicating copy to clipboard operation
com.unity.perception copied to clipboard

Building a perception simulator on Linux

Open mark1ng123 opened this issue 2 years ago • 10 comments

Hey there everyone, I have done some digging and was able to build my simulator on my Ubuntu 20.04, after I've built the simulator i noticed my labels aren't rendering, my data which the simulation should generate is not being saved to the output path I've set. Everything is being added in runtime, whether its the prefabs I'm using, the randomisation tags, the labels, everything, but when the simulation runs as an executable the simulation does run smoothly but nothing is being saved and no label is being shown. I'm also receiving this warning while building:

A meta data file (.meta) exists but its asset 'Assets/Resources/PerceptionPackageVersion.json' can't be found. When moving or deleting files outside of Unity, please ensure that the corresponding .meta file is moved or deleted along with it.  

I've tried everything that was suggested in the unity forums but it didn't help, What can be the problem, Thank you in advance, Mark


Edit: The pictures are being saved in RGB format, but the instance seg pictures are completly black #562

mark1ng123 avatar Feb 27 '23 13:02 mark1ng123

hello @mark1ng123.

We saw the same issue with black-generated images on Linux machines on AWS. The executable machine has a GPU connected, but there was no proper driver installed in the system. The details about this can be found in the Player-related logs for your executable.

You can ignore the warning about the ".meta' file if there are no other errors\warnings in your log. That's a technical file that is generated by the package and deleted after the build is prepared.

vvernygora-unity3d avatar Feb 28 '23 19:02 vvernygora-unity3d

@vvernygora-unity3d Thank you for your fast response, What do i need to look for in the logs? You claim the reason why i get black generated images for the segmentation is drivers? A small reminder my RGB output is fine my problem the instance segmentation is generated all black and also during the simulation the labels arent even showing when its running on exe.

mark1ng123 avatar Mar 01 '23 07:03 mark1ng123

@mark1ng123 If you have proper RGB images, there is no issue with drivers. Can you check sample scenes? Do you get proper segmentation output?

vvernygora-unity3d avatar Mar 01 '23 17:03 vvernygora-unity3d

@vvernygora-unity3d what do you mean by sample scenes? When im using the editor im getting a perfect output and i can see it annotated during the simulation. When im building my instance segmentation PNGs are completely black and i cant see it annotated during simulation.

mark1ng123 avatar Mar 02 '23 04:03 mark1ng123

@mark1ng123 An example of samples can be found HERE. Feel free to build InstanceSegmentation to verify functionality.

Black PNGs mean that nothing was labelled by the camera.

Also, feel free to send an email to [email protected] with details/logs and we will try to assist you.

vvernygora-unity3d avatar Mar 02 '23 18:03 vvernygora-unity3d

@vvernygora-unity3d Thank you very much, il do the tests during the work week and il report back over this issue and mail

mark1ng123 avatar Mar 03 '23 18:03 mark1ng123

@vvernygora-unity3d I built the examples and it worked perfectly, I sent you an email with my logs, i really don't know why my build is not working like yours :), Hope you can help me figure it out

mark1ng123 avatar Mar 06 '23 11:03 mark1ng123

@vvernygora-unity3d Hey, I looked into it, and when i use the cloned version of the github it is building perfectly and run great. but when i import the HDRP samples that hold the scene and try to build it from my project it gives the same bug i ran into. I tried to copy my project into yours and i get the error that i am not using an HDRP project and i cant run the perception package because of it. If you are not using an HDRP project core which one are you using then? image

mark1ng123 avatar Mar 08 '23 12:03 mark1ng123

@mark1ng123 Perception is built on top of the general HDRP project.

You can check the source code and see that this error means that unity project does not have HDRP package or it was removed.

Also, if you are coping scenes, check if any project settings may be updated. THIS is a proper way to copy scenes.

vvernygora-unity3d avatar Mar 08 '23 17:03 vvernygora-unity3d

@vvernygora-unity3d Hey, Exporting my package and importing the package in your project did work, I wonder did i miss any HDRP settings or is there a bug when installing the package from the git url, Anyhow i manged to find a tricky solution with your project, can we identify it and maybe build a tutorial together on how to build properly ?

mark1ng123 avatar Mar 12 '23 14:03 mark1ng123