k-diffusion icon indicating copy to clipboard operation
k-diffusion copied to clipboard

Use of DCT in loss function?

Open jasonhu4 opened this issue 1 year ago • 0 comments

I am wondering why in layers.py, the DCT is used like so: sq_error = dct(model_output - target) ** 2 In contrast to many other diffusion model papers where the loss is simply something like the MSE with a weighting factor? How does this impact the training process?

jasonhu4 avatar Jul 12 '24 18:07 jasonhu4