Blender-ControlNet icon indicating copy to clipboard operation
Blender-ControlNet copied to clipboard

Nothing happens following instruction.

Open ssbugman opened this issue 2 years ago • 15 comments

I did all manual steps and getting just blender cube render on F12. Activating script just print new "bpy.ops.text.run_script()" line in tab under Blender terminal window. Seems manual missing important steps.

ssbugman avatar Mar 18 '23 18:03 ssbugman

You might need a couple of things --- but the addon might (not) work depends on the latest ControlNet update, but few pointers:

  • you gotta have ControlNet to be able to be controlled using other script, this is in the setting under Automatic1111
  • you probably better of to have 3D models or rig that can later translate into: depth, openpose bones, canny, etc
  • when you hit F12, it will render in Blender, and the after that, it will send the image into Automatic1111, process it using the ControlNet and the model of your choice, and return the new image that's generated using AI.

enzyme69 avatar Mar 19 '23 09:03 enzyme69

And also this annoying --api mode https://github.com/coolzilj/Blender-ControlNet/issues/5

enzyme69 avatar Mar 19 '23 09:03 enzyme69

I had the same problem.

enabling scripts and putting --api in startup args worked.

JosipKustan avatar Mar 19 '23 13:03 JosipKustan

I don't know, I had "Allow other script to control this extension" enabled, and run with --api. I don't see anything sent to Auto1111. I tried using fbx I d/l from Mixamo, placed in front of camera, deleted initial cube, ran script, F12ed. I get a photo that had nothing to do with the Blender objects. blender-3.5.89beta

Natotela avatar Mar 20 '23 21:03 Natotela

sorry it's broken right now, check notes on sd-webui addon.

AidenRiley avatar Mar 21 '23 05:03 AidenRiley

Migrated to the new ControlNet API already, please refer to the readme for any changes.

coolzilj avatar Mar 21 '23 09:03 coolzilj

broken again, old demo.py functions as expected, but executing multicn.py and rendering in blender fails to connect to stable diffusion web ui in API mode.

jay-meshed3d avatar Mar 21 '23 10:03 jay-meshed3d

broken again, old demo.py functions as expected, but executing multicn.py and rendering in blender fails to connect to stable diffusion web ui in API mode.

Did you update SD and CN extension to latest? What error messages did you see?

coolzilj avatar Mar 21 '23 10:03 coolzilj

You are right, I had followed your instructions few minutes before the update, reinstalling everything sorted it out. Thank you!

jay-meshed3d avatar Mar 21 '23 11:03 jay-meshed3d

Im having the same issue, dosnt seem to send. I have the latest SD and CN and followed the steps, put in the args. I copied the multicn.py script left it at default only changes path. But it dosnt seem to send it

steffenbk avatar Mar 21 '23 22:03 steffenbk

Im having the same issue, dosnt seem to send. I have the latest SD and CN and followed the steps, put in the args. I copied the multicn.py script left it at default only changes path. But it dosnt seem to send it

Multi-ControlNet / Joint Conditioning (Experimental) This option allows multiple ControlNet inputs for a single generation. To enable this option, change Multi ControlNet: Max models amount (requires restart) in the settings. Note that you will need to restart the WebUI for changes to take effect.

Did you enable multi-controlnet?

coolzilj avatar Mar 22 '23 01:03 coolzilj

To solve your problem I had the same problem as you and I solved it by simply putting the same path for my depth and seg images (in this example) in the script and in the Blender Compositor. Once this is done, Stable Diffusion launches in the CMD window and calculates my rendering !

(see attached screenshot, I highlighted what needs to be changed in yellow stabilo)

lugi10 avatar Apr 07 '23 12:04 lugi10

Is it broken or still functioning, because i ve fixed the folder path as @lugi10 , but the rendered image showed up as b&w like this:

Screenshot_5

Also, nothing is sent to A1111 teminal either. I even made sure to download all same controlnet models that are used in the script.

phdai avatar Apr 17 '23 07:04 phdai

Identify you set correct model name of depth and seg units in multicn.py. For example: depth_cn_units = { "mask": "", "module": "none", "model": "control_v11f1p_sd15_depth", seg_cn_units = { "mask": "", "module": "none", "model": "control_v11p_sd15_seg",

after that, please check the model(.pth) is in the model folder(\stable-diffusion-webui\extensions\sd-webui-controlnet\models) model link

BigTsung avatar May 26 '23 02:05 BigTsung

Is it broken or still functioning, because i ve fixed the folder path as @lugi10 , but the rendered image showed up as b&w like this:

Screenshot_5

Also, nothing is sent to A1111 teminal either. I even made sure to download all same controlnet models that are used in the script.

Hi! I was running into the same issue. But I've found the solution. The issue is that the depth network is too heavy and stable-diffusion kills itself due to memory issues. Therefore, you can check the "low VRAM" checkbox in the web UI and try again. It should work. Also, you may not need the segmentation network. Just try the depth for now.

tanjary21 avatar Aug 29 '23 07:08 tanjary21