InternLM-XComposer icon indicating copy to clipboard operation
InternLM-XComposer copied to clipboard
verified publisher icon InternLM

Multi-GPU inference

Open Yanbing-Han opened this issue 1 year ago • 1 comments

Hello! I got this error when running examples/example_chat.py and share-cap_batch_infer.py with multiple gpus. Does anyone know how to solve it ? image

Yanbing-Han avatar May 31 '24 00:05 Yanbing-Han

When I set os.environ['CUDA_LAUNCH_BLOCKING'] = '1', it reveals more details. image

Yanbing-Han avatar May 31 '24 01:05 Yanbing-Han