Nityanand Mathur

Error while using CLIP embeddings with VisualBERT.

1

### System Info - `transformers` version: 4.26.0 - Platform: Linux-4.18.0-348.2.1.el8_5.x86_64-x86_64-with-glibc2.28 - Python version: 3.10.8 - Huggingface_hub version: 0.11.1 - PyTorch version (GPU?): 1.12.1 (True) - Tensorflow version (GPU?): not installed...

Hi @daemon! I am trying to visualize attention maps for each intermediate timestep. For which I tried to change the `self.time_idx` parameter. Unfortunately, it didn't bring out any change. https://github.com/castorini/daam/blob/c30493ed0154bfccb6c342400f25cc24599bb1ff/daam/trace.py#L38...

Hi, thanks for this amazing work. Have you considered training Marigold using LoRA adapters? If yes, could you please share the implementation?

TensorRT Optimization

6

Is there any TensorRT optimised inference available?

Is there any TensorRT optimised inference available?