GxjGit

How to use tensorstore with PyTorch Dataloader

4

How would I use tensorstore with PyTorch Dataloader? Any examples?

[BUG]: examples/images/diffusion ran failed

13

### 🐛 Describe the bug I ran the example of diffusion according to https://github.com/hpcaitech/ColossalAI/tree/main/examples/images/diffusion： steps: **conda env create -f environment.yaml conda activate ldm pip install colossalai==0.1.10+torch1.11cu11.3 -f https://release.colossalai.org git clone...

[BUG]: How can run examples/images/diffusion with use_ema

4

### 🐛 Describe the bug I can successfully ran the exampls with default setting. according to https://github.com/hpcaitech/ColossalAI/tree/main/examples/images/diffusion When I change the value of use_ema from False to True, error occurred:...

### 🐛 Describe the bug python scripts/txt2img.py --prompt "Teyvat, Name:Layla, Element: Cryo, Weapon:Sword, Region:Sumeru, Model type:Medium Female, Description:a woman in a blue outfit holding a sword" --plms --outdir output --config...

I have reported an issue in DeepSpeedExamples: https://github.com/microsoft/DeepSpeedExamples/issues/448 For in-depth analysis， I saw the definition of module for gptneox in the following file: https://github.com/microsoft/DeepSpeed/blob/master/deepspeed/module_inject/containers/gptneox.py See the following calling relationship： DeepSpeedGPTInference...

The directory structure is not onsistent with meta list

2

Whe I export churches_lmdb to churches by cmd: python3 data.py export churches_lmdb --out_dir churches The directory structure like this:  but the meta list is just only show the filename...

training LDMs on the LSUN- : FileNotFoundError: [Errno 2] No such file or directory: 'data/lsun/churches/c11ef56b368fec4c3e35532a7c750a0a1941f912.webp'

5

I prepared my data following README:  Whe I export churches_lmdb to churches by cmd: python3 data.py export churches_lmdb --out_dir churches The directory structure like this:  but the meta...

[DeepSpeedExamples/applications/DeepSpeed-Chat/] Error happened when running step3_rlhf_finetuning in enable_hybrid_engine mode with togethercomputer/GPT-NeoXT-Chat-Base-20B

2

Error info: File "/opt/conda/lib/python3.8/site-packages/deepspeed/runtime/hybrid_engine.py", line 99, in new_inference_container File "/opt/conda/lib/python3.8/site-packages/deepspeed/module_inject/containers/gptneox.py", line 95, in get_hidden_heads IndexError _container.create_ds_model_config() File "/opt/conda/lib/python3.8/site-packages/deepspeed/module_inject/containers/base.py", line 79, in create_ds_model_config : tuple index out of range return self.client_module.attention.query_key_value.weight.shape[1],...

[Windows] Build from source fails with `Filename too long error: unable to create file `

17

# 🐛 Bug ## Command pip install ninja pip install -v -U git+https://github.com/facebookresearch/xformers.git@main#egg=xformers ## ERROR INFO /tmp/pip-install-zruba6fo/xformers_c3f4b10bded7460eaa800569194ec7d2/xformers/csrc/attention/cuda/fmha/attention.cu:650:66: required from ‘void _GLOBAL__N__7fac2228_12_attention_cu_724ba955_12677::launch_attention(at::Tensor&, at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&, const at::Tensor&,...