ControlNet icon indicating copy to clipboard operation
ControlNet copied to clipboard

normal-map-model: unexpected output

Open tensorflowi opened this issue 2 years ago • 1 comments

Awesome work! :)

One Problem, I tried the normals model and don't get any good results when I provide my own normals map.

Here is what I mean:

  1. my own normals map and the output (output completely useless) Screenshot from 2023-04-05 22-10-37 Screenshot from 2023-04-05 22-10-40

  2. my own normals map, additionally preprocessed with the normals preprocessor, and the output (output as expected) Screenshot from 2023-04-05 22-11-14 Screenshot from 2023-04-05 22-11-18

Why I get completely useless outputs with my own normals map? Is it the wrong color scheme? Maybe you can share your code on how you convert depth maps to normal maps so that I can replicate the color scheme :)

tensorflowi avatar Apr 05 '23 20:04 tensorflowi

you need to check if your normal map's RGB channels map to $\Delta x, \Delta y, \Delta z$, respectively. And mind the direction (pointing inward/outward)

ernestchu avatar May 09 '23 04:05 ernestchu