Qixiang Mo

Issue with Text Encoder Output Dimensions in Fine-Tuned CLIP Model When Using with Stable Diffusion

2

I'm encountering an issue with the dimensions of the text encoder output in a fine-tuned CLIP model. The fine-tuning output of my CLIP model based on RN50 is (1, 1024),...

ModernBertPreTrainedModel for word-level prediction tasks

8

Hi there! I am trying to fine-tune ModernBertPreTrainedModel to complete the task of predicting each word in a sentence. I customized a model, but when the model class inherits ModernBertPreTrainedModel...