ColossalAI-Examples icon indicating copy to clipboard operation
ColossalAI-Examples copied to clipboard

It seems the pipeline parallel document is out of date(https://www.colossalai.org/docs/features/pipeline_parallel)

Open lambda7xx opened this issue 3 years ago • 7 comments

📚 The doc issue

It seems the pipeline parallel document is out of date(https://www.colossalai.org/docs/features/pipeline_parallel). When I try to use from colossalai.builder import build_pipeline_model, it seems it's none

lambda7xx avatar Nov 11 '22 14:11 lambda7xx

@Gy-Lu @ver217 @binmakeswell can you update the PP doc?

feifeibear avatar Nov 14 '22 05:11 feifeibear

@Gy-Lu @ver217 @binmakeswell can you update the PP doc?

could you add the sequence parallelism doc? thank you very much.

lambda7xx avatar Nov 14 '22 06:11 lambda7xx

Hi @lambda7xx Thank you for your feedback. We will try to reproduce your issue and fix it soon.

binmakeswell avatar Nov 15 '22 05:11 binmakeswell

@Gy-Lu @ver217 @binmakeswell can you update the PP doc?

could you add the sequence parallelism doc? thank you very much.

Hi @lambda7xx For sequence parallel, you can check it here https://github.com/hpcaitech/ColossalAI/tree/main/examples/tutorial/sequence_parallel

binmakeswell avatar Nov 17 '22 09:11 binmakeswell

@lambda7xx Hi, we are now re-developing Pipeline Parallel so the doc is not ready to be updated. Here is an example for new Pipeline Parallel interface, FYI. We will update the doc as soon as possible. Thank you for your feedback. If you have any questions about the example, pls at me.

Wesley-Jzy avatar Nov 17 '22 09:11 Wesley-Jzy

https://github.com/hpcaitech/ColossalAI-Examples/tree/main/features/pipeline_parallel

Wesley-Jzy avatar Nov 17 '22 09:11 Wesley-Jzy

@Gy-Lu @ver217 @binmakeswell can you update the PP doc?

could you add the sequence parallelism doc? thank you very much.

Hi @lambda7xx For sequence parallel, you can check it here https://github.com/hpcaitech/ColossalAI/tree/main/examples/tutorial/sequence_parallel

I have an issue about the link(https://github.com/hpcaitech/ColossalAI/tree/main/examples/tutorial/sequence_parallel).

https://github.com/hpcaitech/ColossalAI-Examples/issues/195#issuecomment-1318358272)

I think there may be some bug of the example

lambda7xx avatar Nov 17 '22 10:11 lambda7xx