EN / RU / 🤖
← Back to essays
· Essay · 1 min

ControlNET: The Next Step in AI for Diffusion Models

ControlNET is the next step in AI that allows for additional control in diffusion models.

<p>ControlNET is the next step in AI that allows for additional control in diffusion models (like Stable Diffusion).</p>
<p>For example, ControlNET enables you to add a text prompt to Stable Diffusion and create a link between img+text to img.</p>
<p>Paper: <a href="https://arxiv.org/abs/2302.05543">https://arxiv.org/abs/2302.05543</a><br />Code: <a href="https://github.com/lllyasviel/ControlNet">https://github.com/lllyasviel/ControlNet</a><br />Sandbox: <a href="https://huggingface.co/spaces/hysts/ControlNet">https://huggingface.co/spaces/hysts/ControlNet</a></p>;
<p>P.S. By the way, you’ve probably seen videos where scenes change frame by frame; they are made using this technology.</p>

ControlNET: The Next Step in AI for Diffusion Models — illustration