ggml-org/llama.cpp b12048

on GitHub

sycl : fast ggml_sycl_comm_exchange() on Intel Arc Pro B70s (#30956)

• Update ggml-sycl.cpp

Increases -sm tensor prompt eval t/s by +19% with zero PPL change.

• Update ggml-sycl.cpp

Replace first pair of wait() calls with ext_oneapi_submit_barrier(). The wait() calls was discovered to cause MTP degradation.

• Update ggml-sycl.cpp

Adding comm_exchange function pointer to switch between 2 and 4 buffer ggml_sycl_comm_exchange versions @ initialization time (versus hot path) controlled by SYCL_ENABLE_DEFAULT_CONTEXTS=1 setting.

• Update ggml-sycl.cpp

adding back 2nd half of 4-buffer free.

• Update ggml-sycl.cpp

Removing extra whitespace.

• Update ggml-sycl.cpp

Excluding Windows until it is validated on Windows.