micro-sam icon indicating copy to clipboard operation
micro-sam copied to clipboard

Scribble-based segmentation

Open anwai98 opened this issue 1 year ago • 3 comments

This in particular could potentially be a nice feature to segment vessel-like thin (and long) structures using positive scribblles, or eliminate the outside-boundary region in-a-go for parts outside the object using negative scribbles.

anwai98 avatar May 13 '24 07:05 anwai98

I agree that this is a good idea. I see two possible ways to implement it:

  • Derive a mask prompt from the scribbles. This is easy to implement, but I am a bit pessimistic if it will help much. In any case, we can try.
  • Train a new prompt encoder for it. I think that is in principle more promising, but also more work.

Any other ideas from your end for how to address this?

constantinpape avatar May 13 '24 08:05 constantinpape

I was thinking in the direction of a simpler version of the first method, however the second one actually sounds more promising.

Also leaving a hint, I think Mehdi has an implementation for scribble-based segmentation with SAM - https://github.com/juglab/napari-sam-labeling-tools

anwai98 avatar May 13 '24 15:05 anwai98