Anh Nguyen (Aengus)

icon indicating an email [email protected]

icon company @VinAIResearch icon location Love the combination of mathematics, coding, and intuition. Contributor @huggingface 🤗; AI Research Resident @VinAIResearch

Results 1 issues of Anh Nguyen (Aengus)

[happy to fix this] Wrong a weighted mean squared error loss

1 comment

https://github.com/huggingface/diffusers/blob/acd317810bc138b3a78fa30e1b3da1006c1d60ad/examples/unconditional_image_generation/train_unconditional.py#L421-L428 1. Big issue: `alpha_t / (1 - alpha_t)` is the **signal-to-noise ratio (SNR)**. The weighting scheme `snr_weights` is different from the paper and doesn't make sense because the weight...