Instance segmentation problem

[ZivniR]

hello,

I have a lot of questions 😄 but the instance segmentation doesn't work with

skeletal mesh my skeletal mesh if it inside a blueprint or not it still get value of [84,84,84] and doesn't change

although the client.simSetSegmentationObjectID return true and the object shown in the list client.simListInstanceSegmentationObjects()

i use unreal 5.4.4

in this image you can see that the third person doesn't get a color.

but in Blocks environment everything is fine!

except when I use main skeletal mesh with sub skeletal meshes its only give segmentation to the main skeletal mesh and the sub skeletal mesh doesn't get any color. (when in the original airsim they get colors)

thank you very much

[WouterJansen]

Hi! Is the skeletal mesh something that spawns after you press play? In that case the instance segmentation system will not automatically give any spawned mesh an ID or add it to the system, this has to be done manually. This can be done from the API or through blueprint functions.

https://cosys-lab.github.io/instance_segmentation/ https://cosys-lab.github.io/image_apis/#segmentation

Let me know if you need more help with this, there arent really good examples in the current repository so I can understand it might not be clear on how to do this.

[ssaigarimella]

@WouterJansen Thanks for your reply, can you please provide some good example on how to do this? Additionally, I see in the Instance Segmentation usage documentation, there should be a function called ASimModeBase::AddNewActorToSegmentation(AActor) somewhere but I think this doesn't exist. Can you please confirm this?