ggml-org/llama.cpp b9049

on GitHub

mtmd : support MiniCPM-V 4.6 (#22529)

• Support MiniCPM-V 4.6 in new branch

Signed-off-by: tc-mb tianchi_cai@icloud.com

• fix code bug

Signed-off-by: tc-mb tianchi_cai@icloud.com

• fix pre-commit

Signed-off-by: tc-mb tianchi_cai@icloud.com

• fix convert

Signed-off-by: tc-mb tianchi_cai@icloud.com

• rename clip_graph_minicpmv4_6

Signed-off-by: tc-mb tianchi_cai@icloud.com

• use new TYPE_MINICPMV4_6

Signed-off-by: tc-mb tianchi_cai@icloud.com

• use build_attn to allow flash attention support

Signed-off-by: tc-mb tianchi_cai@icloud.com

• no use legacy code, restored here.

Signed-off-by: tc-mb tianchi_cai@icloud.com

• use the existing tensors name

Signed-off-by: tc-mb tianchi_cai@icloud.com

• unused ctx->model.hparams.minicpmv_version

Signed-off-by: tc-mb tianchi_cai@icloud.com

• use n_merge for slice alignment

Signed-off-by: tc-mb tianchi_cai@icloud.com

• borrow wa_layer_indexes for vit_merger insertion point

Signed-off-by: tc-mb tianchi_cai@icloud.com

• fix code style

Signed-off-by: tc-mb tianchi_cai@icloud.com

• Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

• use filter_tensors and add model.vision_tower

Signed-off-by: tc-mb tianchi_cai@icloud.com

• fix chkhsh

Signed-off-by: tc-mb tianchi_cai@icloud.com

• fix type check

Signed-off-by: tc-mb tianchi_cai@icloud.com

Signed-off-by: tc-mb tianchi_cai@icloud.com
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com