Kazuki Fujii

@deepakn94 Sorry for the late reply, I don't use PyTorch NGC Container.

@deepakn94 We did not encounter the problem when using the university's supercomputer (H100: [TSUBAME-4](https://www.t4.gsic.titech.ac.jp/en) ) instead of the A3 Instance on Google Cloud Platform. I'm not sure what the issue...

`git switch villa1.5` and ```bash python -W ignore llava/eval/run_vila.py \ --model-path Efficient-Large-Model/Llama-3-VILA1.5-8b \ --query "\n Please describe the traffic condition." \ --image-file "demo_images/av.png" ``` Works for me with the above...

I think this issue is already fixed. https://github.com/NVIDIA/Megatron-LM/commit/d8c6aa4c0b5d4c15ec1196802bce292d4580ed4a