diffusers
diffusers copied to clipboard
huggingface
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
It's not clear if ControlNetPlus is already supported by diffusers https://github.com/xinsir6/ControlNetPlus/tree/main/pipeline which consists of union controlnet for SDXL. This model seems to support the only SDXL segmentation that I'm aware...
This PR adds - `--lora_layers` and `--lora_blocks` to dreambooth lora training script to allow targeting specific blocks & layers. - This is generally proven to be useful, and specifically for...
### Describe the bug When using the recently released PyTorch 2.5, the default SDPA backend is CUDNN_ATTENTION. In the example's CogVideoX-lora [training script](https://github.com/huggingface/diffusers/tree/main/examples/cogvideo), NaN gradients occur right at the first...
Relevant comments are [this](https://github.com/huggingface/diffusers/pull/8897#issuecomment-2255416318) and [this](https://github.com/huggingface/diffusers/pull/8897#issuecomment-2255478105). AnimateDiff SparseCtrl RGB does not work similar to other implementations and cannot replicate their outputs. This makes me believe that there is something incorrect...
# What does this PR do? The layer configuration for the Control Net in Stable Diffusion 3 models must adhere to the rule that the total number of layers in...
### Describe the bug train_dreambooth_lora_flux.py when running with --train_text_encoder --optimizer="prodigy" causes IndexError: list index out of range because of this: 09/18/2024 20:06:33 - WARNING - __main__ - Learning rates were...
### Describe the bug This time i set amount of steps to 2 to make sure it correctly saves the model after an hour of training. But it does not....
**Is your feature request related to a problem? Please describe.** Currently, batching is not supported when we are conditioning the SDXL pipeline on multiple controlnets: https://github.com/huggingface/diffusers/blob/28f9d84549c0b1d24ef00d69a4c723f3a11cffb6/src/diffusers/pipelines/controlnet/pipeline_controlnet_inpaint_sd_xl.py#L771 **Describe the solution you'd...
### Describe the bug ```python @classmethod def from_pretrained(cls, path, model_cls, foreach=False) -> "EMAModel": _, ema_kwargs = model_cls.load_config(path, return_unused_kwargs=True) model = model_cls.from_pretrained(path) ema_model = cls(model.parameters(), model_cls=model_cls, model_config=model.config, foreach=foreach) ema_model.load_state_dict(ema_kwargs) return ema_model...
I was reading the paper [Common Diffusion Noise Schedules and Sample Steps are Flawed](https://arxiv.org/abs/2305.08891) and found it pretty interesting. It proposes a few simple changes that could be useful when...
Metadata
Owner
Metadata
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.