Is there any official support for Multi-GPU?

[genkv]

Hey first of all I love this project and the fantastic performance it brings.

I was just wondering if there's any plan to support multi-GPU in the future? The 13b dev model needs at least an A100 80G to run on, but similar VRAM can be achieved by 4x3090, which is a lot more cost-efficient. Thanks.