Max Lu

how to apply custom transformation to image crops before feature extraction

9

Hi, thanks for the awesome tool. I am interested in doing some kind of normalization/custom transformation on the image before I run feature extraction (calculate_image_features). But all of my attempts...

Is biogpt's tokenizer bugged?

3

### System Info - `transformers` version: 4.27.1 - Platform: Linux-5.15.0-67-generic-x86_64-with-glibc2.17 - Python version: 3.8.13 - Huggingface_hub version: 0.11.1 - PyTorch version (GPU?): 1.13.1 (True) ### Who can help? @ArthurZucker and...

how to support more CLM models?

1

Hi, I am trying to use prefix tuning with biogpt: https://github.com/huggingface/transformers/blob/v4.27.1/src/transformers/models/biogpt/modeling_biogpt.py#L440 Following the prefix tuning + CLM example, I am able to train without issue, but once the model is...

Unused arguments: n_queries and attn_pooler_heads in MultimodalCfg

4

Hi, thanks @gpucce for implementing CoCa! I am reading the code, and under MultimodalCfg (used by CoCa to construct the multimodal decoder) there is n_queries and attn_pooler_heads ([here](https://github.com/mlfoundations/open_clip/blob/7ae3e7a9853b1aa2fe7825e4272f3b169f8e65af/src/open_clip/coca_model.py#L45)), but correct...