latent-diffusion icon indicating copy to clipboard operation
latent-diffusion copied to clipboard

Difference between LDM and pixel-level DDPM.

Open Kenny-K opened this issue 2 years ago • 1 comments

In pixel-level DDPM, the linear noise schedule is established with beta_0 = 1e-4 and beta_T = 0.02. However, in LDM, the range of (beta_0, beta_T) is reduced. For instance:

params:  
    linear_start: 0.0015  
    linear_end: 0.0195  

Additionally, DDPM learns a weighting on the variance, while LDM fixes the variance as posterior and eliminates the VLB term.

What is the rationale for this discrepancy?

Kenny-K avatar Aug 01 '23 08:08 Kenny-K

Hi @Kenny-K , were you able to find some information regarding the reduced range of betas ? I was having the same doubt and wanted to get some clarity on reasons for using this schedule

tusharkumar91 avatar Feb 05 '24 06:02 tusharkumar91