Thanks again to @happyyzy for optimizing on-device DiT inference on Hexagon!
This release brings all seven built-in DiT models to Snapdragon 8 Gen 2 and 8 Gen 3. On these chips, the new W4A8 ConvRot kernel runs with 4-bit weights and 8-bit activations. Keeping text encoder weights on disk reduces peak memory usage. #365
Variants:
- LocalDream_xxx_with_filter: includes NSFW result filtering, as in the Google Play version.
- LocalDream_xxx: no filter.