bing0037

Is the code still able to run?

3

Hi, I am trying to reproduce your result of BERT. I followed the Prerequisite: ``` # Pytorch pretrained BERT git clone https://github.com/pmichel31415/pytorch-pretrained-BERT cd pytorch-pretrained-BERT git checkout paul cd .. ```...

[Question] How to launch jobs with Docker env using multiple nodes in DeepSpeed?

5

**Problem**: How to run [ds_pretrain_gpt2-zero3.sh](https://github.com/microsoft/DeepSpeedExamples/blob/master/megatron/Megatron-LM-v1.1.5-ZeRO3/examples/ds_pretrain_gpt2-zero3.sh) in docker env using 2 nodes? **Current platform**: 1) I have 2 nodes (100.3.8.100 & 100.3.8.68). For each node (with 8 V100 GPUs), the docker...

有没有收发红包功能？

1

试了一下，现在可以看到`msg.message_type()` 是`MessageType.MESSAGE_TYPE_RED_ENVELOPE`，但是不知道如何收发红包呀？求大神指导，或者如果没有的话，大神能不能提供个接口？ 感谢！

GPU memory reduction: will this method reduce GPU memory consumption?

1

Hi, Thanks for you excellent work on Dynamic Sparse Training. I am trying to reproduce your work and **to reduce GPU memory consumption** during sparse training. I read through your...

### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this...