huggingface/optimum-intel v1.21.0

v1.21.0: SD3, Flux, MiniCPM, NanoLlava, VLM Quantization, XPU, PagedAttention

on GitHub

What's Changed

OpenVINO

Diffusers

• SD3 and Flux pipelines support by @eaidova in #916

VLMs Modeling

• MiniCPMv support by @eaidova in #972
• NanoLlava support by @eaidova in #969
• Phi3v support by @eaidova in #977

NNCF

• Quantization support for CausalVisualLMs by @nikita-savelyevv in #951
• NF4 data type support for OV weight compression by @l-bat in #988
• NNCF 2.14 new features support by @nikita-savelyevv in #997

IPEX

• Unified XPU/CPU modeling with custom PagedAttention cache for LLMs by @sywangyi in #1009

INC

• Layer-wise quantization support by @changwangss in #1040

New Contributors

• @emmanuel-ferdman made their first contribution in #974
• @mvafin made their first contribution in #1033

Full Changelog: v1.20.0...v1.21.0