Yoshinari Fujinuma

Add interpolation of position encodings to BLIP-2

4

### Feature request ViT implemented in Huggingface Transformers has the feature to enable finetuning with different resolution of images https://huggingface.co/docs/transformers/model_doc/vit#transformers.ViTModel.forward.interpolate_pos_encoding while the newly implemented BLIP-2 model does not. Would like...

ValueError: You can't train a model that has been loaded in 8-bit precision on multiple devices.

6

@younesbelkada (Thanks again for developing these great libraries and responding on Github!) Related issue: https://github.com/huggingface/accelerate/issues/1412 With the bleeding edge `transformers`, I cannot combine PEFT and accelerate to do parameter-efficient fine-tuning...

License?

2

Hi! Nice work on https://github.com/PaddlePaddle/VIMER/tree/main/StrucTexT/v2. What is the license of the pretrained model and the code? Is it Apache License (same as the Paddle and the PaddleOCR repo?) CC: @zhouwei25