Transformers-Tutorials icon indicating copy to clipboard operation
Transformers-Tutorials copied to clipboard
verified publisher icon NielsRogge

Dinov2 HF based notebooks with multi scale and Mask2former

Open ayushnangia opened this issue 1 year ago • 1 comments

Hi,

Train_a_linear_classifier_on_top_of_DINOv2_for_semantic_segmentation

Great notebook but does anyone know how to work with multi scale and mask2former with dinov2 and how use dino with registers?

ayushnangia avatar Jun 18 '24 00:06 ayushnangia

Hi,

  • DINOv2 with registers isn't supported yet in the Transformers library, see https://github.com/huggingface/transformers/issues/27379.
  • Mask2Former suppors loading DINOv2 as backbone, including with pre-trained weights. Could you clarify multi-scale?

NielsRogge avatar Jul 01 '24 09:07 NielsRogge