ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard
verified publisher icon hpcaitech

[FEATURE]: require convenient hybrid_parallel example

Open binmakeswell opened this issue 3 years ago • 1 comments

Describe the feature

Most users do not have 64 GPUs to try these config, maybe use less resource? https://github.com/hpcaitech/ColossalAI-Examples/tree/main/image/vision_transformer/hybrid_parallel

binmakeswell avatar Apr 02 '22 10:04 binmakeswell

ViT+CIFAR example will come soon.

binmakeswell avatar Apr 13 '22 05:04 binmakeswell

We have updated a lot. This issue was closed due to inactivity. Thanks. https://github.com/hpcaitech/ColossalAI/tree/main/examples

binmakeswell avatar Apr 13 '23 03:04 binmakeswell