flybird11111 issues

Results 28 issues of


                                            flybird11111

[booster] gemini plugin support shard checkpoint

## 📌 Checklist before creating the PR - [ yes ] I have created an issue for this PR for traceability - [ yes ] The title follows the standard...

Run Build and Test

API

gemini plugin support shard checkpoint.

gemini plugin support shard checkpoint to avoid large checkpoint files.

gemini plugin add shard checkpoint save/load

[shardformer] hybridparallelplugin support gradients accumulation.

## 📌 Checklist before creating the PR - [x] I have created an issue for this PR for traceability - [x] The title follows the standard format: `[doc/gemini/tensor/...]: A concise...

[shardformer] support using abili for shardformer when enable flash attention

[shardformer] Optimize shardformer.

[shardformer]support gradients accumulation fusion

[hotfix] chat train with lora while tensor does not allocate memory.

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...

[LowLevelZero]: low level zero support lora.

### Describe the feature To reduce memory usage, support for LoRa is provided.

enhancement

[example]add gpt2 benchmark example script.

## 📌 Checklist before creating the PR - [ ] I have created an issue for this PR for traceability - [ ] The title follows the standard format: `[doc/gemini/tensor/...]:...