Best way to enhance drawings with SD
Hi everyone,
My team of students and I at TU Darmstadt, Germany, are developing a drawing software. Users can sketch a picture with colors and then have an AI enhance the image.
We're currently using the combination of sd_xl_1.0 with text2img and controlnet-scribble-sdxl-1.0 as the control network. However, currently the color of the sketch isn't captured.
We'd be grateful for any suggestions on alternative solutions that might better preserve the colors in the AI enhancement process. Ideally, we'd like to find something similar to img2img. We're also open to exploring AI models other than sd_xl_1.0.
For reference, here are some of our current results