v4.2.9rc1 brings the initial FLUX workflow implementation to Invoke. Please note these nodes are still in the prototype stage and are subject to change. This Node API is not stable!
FLUX
We are supporting both FLUX dev and FLUX schnell at this time in workflows only. These will be incorporated into the rest of the UI in future updates. At this time, this is an initial and developing implementation - we’re bringing this in with the intent of long-term stable support for FLUX.
A default workflow can be found in your workflow tab called FLUX Text to Image. Please note that we have not added FLUX to the linear UI yet, LoRAs and Img2Img are not yet supported, but will be added soon.
Thanks to @RyanJDick and @brandonrising for their hard work bringing FLUX support to Invoke.
Required Dependencies
In order to run FLUX on Invoke, you will need to download and install several models. We have provided options in the Starter Models (found in your Model Manager tab) for quantized and unquantized versions of both FLUX dev and FLUX schnell. Selecting these will automatically download the dependencies you need, listed below. These dependencies are also available for adhoc download in Starter Models list. We strongly recommend using the CLIP-L encoder and FLUX VAE provided in our starter models for this initial implementation to work seamlessly.
- T5 encoder
- CLIP-L encoder
- FLUX transformer/unet
- FLUX VAE
Considerations
FLUX is a large model, and has significant VRAM requirements. The full models require 24gb of VRAM on Linux — Windows PCs are less efficient, and thus need slightly more, making it difficult to run the full models.
To compensate for this, the community has begun to develop quantized versions of the DEV model - These are models with a slightly lower quality, but significant reductions in VRAM requirements.
Currently, Invoke is only supporting NVidia GPUs. You may be able to work out a way to get an AMD GPU to generate, however we’ve not been able to test this, and so can’t provide committed support for it. FLUX on MPS is not supported at this time.
Please note that the FLUX Dev model is a non-commercial license. You will need a commercial license to use the model for any commercial work.
Below are additional details on which model to use based on your system:
- FLUX dev quantized starter model: non-commercial, >16GB RAM, ≥12GB VRAM
- FLUX schnell quantized starter model: commercial, faster inference than dev, >16GB RAM, ≥ 12GB VRAM
- FLUX dev starter model: non-commercial, >32GB RAM, ≥24GB VRAM, linux OS
- FLUX schnell starter model: commercial, >32GB RAM, ≥24GB VRAM, linux OS
Running the Workflow
You can find a new default workflow in your workflows tab called FLUX Text to Image. This can be run with both FLUX dev and FLUX schnell models, but note that the default step count of 30 is the recommendation for FLUX dev. If running FLUX schnell, we recommend you lower your step count to 4. You will not be able to successfully run this workflow without the models listed above as required dependencies installed.
The exposed fields will require you to select a FLUX model, a T5 encoder, a prompt, and your step count.
Other Changes
- Fix: Follow-up docker readme fixes by @ebr
- Fix: use empty string fallback if unable to parse prompts when creating style preset from existing image by @maryhipp
- Chore: bump version v4.2.8post1 by @psychedelicious
- Enhancement: Added support for bounding boxes in the Invocation API by @JPPhoto
- Fix: disable export button if no non-default presets by @maryhipp
- Build: remove broken scripts by @psychedelicious
- Fix: missing translation keys for new model types by @maryhipp
Installation and Updating
To install or update to v4.2.9rc1, download the installer and follow the [installation instructions](https://invoke-ai.github.io/InvokeAI/installation/010_INSTALL_AUTOMATED/).
To update, select the same installation location. Your user data (images, models, etc) will be retained.
What's Changed
- Follow-up docker readme fixes by @ebr in #6661
- fix(ui): use empty string fallback if unable to parse prompts when creating style preset from existing image by @maryhipp in #6769
- chore: bump version v4.2.8post1 by @psychedelicious in #6770
- Added support for bounding boxes in the Invocation API by @JPPhoto in #6781
- fix(ui): disable export button if no non-default presets by @maryhipp in #6773
- Brandon/flux model loading by @brandonrising in #6739
- build: remove broken scripts by @psychedelicious in #6783
- fix(ui): fix translations of model types in MM by @maryhipp in #6784
- chore: bump version to v4.2.9rc1 by @brandonrising in #6785
Full Changelog: v4.2.8...v4.2.9rc1