[Single file] fix single file config loading when passing dicts.
What does this PR do?
Fixes https://github.com/huggingface/diffusers/actions/runs/9055285304/job/24876182073#step:7:3821
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
also I thought we are moving all the single-file tests to the same place? are these tests intended to be kept there?
Yeah, I think so too.
https://github.com/huggingface/diffusers/tree/main/tests/single_file has all the tests but I think we need to remove them from tests/models/unets/ and elsewhere.
Actually this test and functionality should be removed. We don't support configuring models via dict in from_pretrained so from_single_file shouldn't support it either. config should be a model repo id or a path to a local model repo. I'll update the test.
Closing the PR then :)