How to set the input length parameter to support long context window e.g. 256k inputs?

[dzyjjpy]

please provide an example. both vision and language are needed, thanks @wilson1yan

[dzyjjpy]

Does the sample scripts/sample_pyt.py support gpu processing? GPU is not used by nvidia-smi command pytorch is installed successfully, cuda is available