diffusers

diffusers copied to clipboard

[Pipeline] Marigold depth and normals estimation

4

# What does this PR do? Fixes #7522. Related to #6533 (community pipeline). This PR adds the family of Marigold pipelines for dense regression tasks. The depth estimation pipeline is...

toshas

[Tests] reduce the model size in the audioldm2 fast test

2

# What does this PR do? Reduces the model sizes in the AudioLDM2 fast tests. Tagging Issue: https://github.com/huggingface/diffusers/issues/7677 CC: @sayakpaul for visibility.

ariG23498

examples/community/lpw_stable_diffusion_xl.py Not correctly decoded

1

### Describe the bug When I used `lpw_stable_diffusion_xl` on a text2img model (`playgroundai/playground-v2.5-1024px-aesthetic`), I found the image gray, seemed not decoded correctly.  To solve this I copied some...

HACLINE

deepfloyd stage 2 crashes with tensor size mismatch when input image size is not divisible by 8

2

### Describe the bug DeepFloyd's upstream code supports 8px-aligned inputs for stage II, which I believe the Diffusers implementation is based upon. However, it seems that for certain sizes, there...

bghira

CLIP Training Example Bug - Overfitting

1

### Describe the bug After reading numerous posts on overfitting, I am convinced that the example run_clip.py has bugs. it doesn't converge. Earlier I posted it for discussion [here](https://github.com/huggingface/diffusers/discussions/7835) ###...

humanely

Update Animatediff docs with Scheduler improvements

1

Residual noise from DDIM and issues with GIF export are affecting the quality of AnimateDiff results. Update docs based on info from this issue: https://github.com/huggingface/diffusers/issues/7548

DN6

accelerate + FSDP + T2I train saving ckpt error

8

### Describe the bug I have used /examples/text_to_image/train_text_to_image_sdxl.py to train a fine tune sdxl. I used accelerate 0.25.0 + FSDP, when I was saving a checkpoint it will stuck and...

Forainest

Slow SDXL inference with JAX on Cloud TPU v5e for sizes other than 1024x1024

5

### Describe the bug Following the blog post on Accelerating Stable Diffusion XL Inference with JAX on Cloud TPU v5e. This worked magically until I tried to generate an image...

zstiggz

[Commuity Scripts]🤗

1

## Community Scripts We added a "Community Scripts" README file to our community folder! 🤗 Please check it out [here](https://github.com/huggingface/diffusers/blob/main/examples/community/README_community_scripts.md) The purpose of this section is to gather tips, tricks,...

yiyixuxu

TextToVideoSDPipeline outputs blank video

10

### Describe the bug I am encountering an issue when using the TextToVideoSDPipeline. It is generating blank videos when I run the model in Replicate. The model is running on...

rafationgson