Acly/krita-ai-diffusion v1.5.0

Version 1.5.0

on GitHub

Download krita_ai_diffusion-1.5.0.zip

If you are updating from a previous release: additional custom nodes and models are required. They can be downloaded automatically via the built-in installer.

Upscaling

Now there is a dedicated UI to upscale images. You can switch with the new button in the top-left:

It allows to upscale the current projection (merged visible layers) by up to factor 4x.

• Upscale model can be chosen explicitly
  • There are 3 recommended models: Default, Quality, Sharp
  • Custom models are also supported (found in ComfyUI/models/upscale_models)
• The "Refine" option will run diffusion on the upscaled image to improve quality
  • 30% strength will stick very closely to the low resolution image
  • 40-50% strength will allow freedom for additional details
  • Generation runs on tiles, so high resolutions (4k, 8k, more...) are possible without requiring more GPU memory

Upscaling makes use of a new control mode "Blur" (aka. ControlNet Tile). It takes blurry image as input (eg. from bilinear resize) and sharpens and adds detail. You can use it in the image generation UI to selectively upscale/refine areas of the image.

Inpaint Improvements

Trying to add new objects to an existing image in an area has felt unintuitive in some cases. The reason is that a lot of context from the existing image is needed to make sure new content "fits in". But this leads to the text prompt having less impact, and sometimes it felt like it's ignored.

• Method 1: Select area, enter text, 100% strength
• Method 2: Select area, enter text, paint a very crude version of the new object, 80% strength

Method 2 has always been quite reliable and predictable! But it's not as intuitive, so in this version Method 1 is improved.

Let's look at an example. We have some nature photo, and it's clearly lacking a bear.

Original	Mask	Prefill for Method 2

Method 1, OLD behavior - only 1 out of 4 images has a bear :(

Method 2 (unchanged) - note that the prefill also gives some control over shape

Method 1, NEW behavior - bears are now very common indeed :)

Other Changes

• Added option to specify negative text prompt in the generation UI (must be activated in interface settings)
• Added option to change number of text lines for the prompt editor (interface settings)
• Made server installation more robust after crash/abort
• Added IP-adapter support for SDXL, requires ip-adapter_sdxl_vit-h.pth in ComfyUI/custom_nodes/ComfyUI_IPAdapter_plus/models
• Support {prompt} placeholder in style prompts (also updated default styles to use this)
• Improved outpainting scenario by excluding image border areas from the IP-adapter reference
• Increased websocket ping timeout for large image transfers when using a remote (internet) server