[BUG]: [DIFFUSION]: While marked as closed issue #2204 still persists,

[Thomas2419]

🐛 Describe the bug

Issue #2204 while the main issue was solved the other that cropped up and was marked closed by pull request #2356 seemed to be a solution that was implemented onto the Dreambooth area, and not the main diffusion one, is this get static torch model a solution that we should be manually implementing into the Diffusion one and it will fix it or was the fix simply for the same type of problem but affecting dreambooth, as still finetuning diffusion does not produce discernable results and only makes random noise.

Environment

No response