ggml-org/llama.cpp b11923

on GitHub

ggml : relax scale to non-contiguous views (#31146)

• ggml : relax scale to non-contiguous views

SCALE requires src0 to be 1D-contiguous. Relax this to dim-0
contiguity with arbitrary row strides (ggml_is_contiguous_rows),
same as the unary ops in the Metal backend.

• ggml: relax the assert in ggml_scale_impl
• cpu: address src0 rows through their byte strides (f32, bf16)
• cuda: stride-aware kernel, fastdiv row decomposition
• metal: support bf16 scale (guarded unary instantiations)
• sycl: keep the gate at contiguous, the kernel is flat f32

Add view variants to test_scale. Verified on CPU, Metal and CUDA.

Assisted-by: dsh:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (RTX 5090 32GB, DDR5 128GB)

• cuda : skip the softcap fusion on non-contiguous views

The fused softcap kernel reads src and writes dst as dense arrays,
so a view reaching SCALE -> TANH -> SCALE now that SCALE accepts
non-contiguous rows would be read wrongly. Keep such graphs on the
strided kernels until the fusion becomes stride aware.

Co-authored-by: Pascal admin@serveurperso.com