Benno Krojer

Missing text-only Transformer in visualization notebook

4

Hi! First of all thank you for your work, it has been quite easy and performant to use so far. I am currently confused looking at the forward() method of...

Hi, Thanks for this great paper+codebase! A deserved best paper award. I am thinking of applying the DAAM idea to image editing models (i.e. InstructPix2Pix: https://github.com/timothybrooks/instruct-pix2pix) and was wondering how...

Hi, I noticed that in the paper you don't mention img2img as Stable Diffusion does. Do you think it is easy to finetune for that? Best, Benno

Bug fix: evaluation script

1

Hi Kai, I just found a small bug in `image_eval.py` line 144 (https://github.com/OSU-NLP-Group/MagicBrush/blob/7fea960a2a98542b9721fb07a5ef8dab3c0a01cc/evaluation/image_eval.py#L144). Can you change the line to: `gt_caption = list(caption_dict[gt_img_name].items())[1][1] ` Right now it throws an error because...

VideoChat2-text basline

7

Hello, Thank you for putting out this amazing set of models, datasets and evals! Is it possible to release the code and details for the VideoChat2-text baseline from your paper?...

functions for MVBench eval in demo_mistral.ipynb

1

Hello, I am currently studying lots of things on MVBench and was wondering why you provided functions for EgoSchema such as check_answer_egoschema() but not for MVBench? Since MVBench is the...

Release of GPT scripts to generate the QA data for MVBench

1

Hello, Thanks for releasing MVBench and all the other great things! I am studying video understanding benchmarks in my research and was wondering if you could release the scripts/prompts for...

Easier way to download raw data

1

Hello, I am wondering if there is any chance to make the dataset more easily accessible as a local download? Specifically just the raw videos and captions without difficult tfrecord...