automatic icon indicating copy to clipboard operation
automatic copied to clipboard

[Feature]: HiDiffusion does not work completely with Prompts From File

Open teamolhuang opened this issue 1 year ago • 1 comments

Issue Description

Using a prompt that has been tested to be outputting good results, keep the basic settings default - 512x512, 20steps - , while using Prompt From File to generate with different configs:

--width 1920 --height 1080 --steps 28 --sampler_name "euler a" --cfg_scale 7
--width 1080 --height 1920 --steps 28 --sampler_name "euler a" --cfg_scale 7
--width 1920 --height 1080 --steps 25 --sampler_name "euler a" --cfg_scale 4
--width 1080 --height 1920 --steps 25 --sampler_name "euler a" --cfg_scale 4
--width 1920 --height 1080 --steps 22 --sampler_name "euler a" --cfg_scale 3
--width 1080 --height 1920 --steps 22 --sampler_name "euler a" --cfg_scale 3

This results in generally bad anatomy, mostly very long human body/waist or double cleavages. Fixing the width/height settings to be either 1920x1080 or 1080x1920 fixes that. Generated ~60 images and at least 90% of them shows such symptom.

This doesn't only apply to resolutions, from what I observe, HiDifussion applies until a certain count of steps, but it seems to read the steps from basic settings as divisor.

This results in different resolutions and different step counts through Prompt From File, combined with HiDiffusion, might cause unexpected results.

Version Platform Description

Windows 11 AMD 6900XT + ZLUDA sd-next 2024-07-01 081c19fc Google Chrome

Relevant log output

No response

Backend

Diffusers

UI

ModernUI

Branch

Master

Model

StableDiffusion XL

Acknowledgements

  • [X] I have read the above and searched for existing issues
  • [X] I confirm that this is classified correctly and its not an extension issue

teamolhuang avatar Sep 11 '24 15:09 teamolhuang

combining multiple advanced options, especially with scripts is considered a feature. in this case, script sets resolution after hidiffusion has already been initialized. prompts-from-file script has not been updated in a long time, its one of the few original scripts. contributions are welcome.

vladmandic avatar Sep 11 '24 16:09 vladmandic