Fazzie

### 🐛 Describe the bug - Get cuda_emptyCache when use Pyrtorch lightning ColossalAIStrategy(https://github.com/Lightning-AI/lightning/blob/master/src/pytorch_lightning/strategies/colossalai.py)   ### Environment _No response_

- add inference - fix bug in ddpm.py - add teyvat dadaset

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

[BUG]: Conflict with Deepspeed and colossalAI for fused adam

2

### 🐛 Describe the bug when the anaconda env has both deepspeed and colossalAI, and we use zero optimizer for deepspeed, I will get error to load Fused Adam, because...

[BUG] Load fused_adam_cuda failed

2

**Describe the bug** I install the deepspeed with `DS_BUILD_OPS=1 pip install deepspeed` and compile the extra keenal, but I get err when I use zero optimizer, I get `fused_adam_cuda =...

[chatgpt] support llama

3

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

Wizard Math 7B cann't stop generate

2

 when I use Wizard Math 7B generate, it can't stop, and out out `` which is same to eos token, and I print the output tensor in torch ,...

fix Can't pickle local object 'check_correctness.<locals>.unsafe_execute

1

fix for the issue https://github.com/openai/human-eval/issues/27