[FEATURE] I need MORE CONTROL over outpainting. Can you make a ControlNet level of control for OUTpainting (using an input image)

[StableInfo]

Hello,
Is it possible to use an input image as a reference for controling how the outpaining image will be?
Let me give an example, let's take this image:

I would like to outpaint the right side but I want to use an image to control what will be outpainted:

So the input image I have to use is this one:

Same thing with this example:

Let's suppose I did not have any idea what is the rest of the image, then we can input an image to control what is the outpaining gonna do:

Outpainted image:

The actual outpaint method you described with the use of the llama thing is random and has not control of what is going to be outpainted except for the prompt and usual parameters.

Can you make something like what I described?
Thanks
@lllyasviel

[TingTingin]

you can combine control nets together when generating so if you want something like this you'd combine the inpaint controlnet and the scribble controlnet

[StableInfo]

Really? I dont understand how no one has ever talked about this, or did a tutorial. Nice I will try to explore it

[geroldmeisinger]

I think this is a better fit for the discussion section of the Automatic1111 extension: https://github.com/Mikubill/sd-webui-controlnet/discussions

(great idea btw!)