SYCL support

[airMeng]

Hi @leejet Following SYCL backend in GGML we plan to contribute native SYCL support to stable-diffusion.cpp. Want some inputs from you.

Possible Implementation

1. update GGML to the latest with SYCL support
2. add similar SYCL option like CUDA
3. update according to the community request.

I notices in the recent SD3 support, the submodule GGML has been dispatched to a fork, will you maintain a fork you GGML yourselves?

cc @zhentaoyu @luoyu-intel @hshen14

[leejet]

I notices in the recent SD3 support, the submodule GGML has been dispatched to a fork, will you maintain a fork you GGML yourselves?

Since the t5 layer norm, which sd3 depends on, is not yet supported by ggml, I created a separate branch to support it. I will submit my changes to the upstream via a PR.

[leejet]

PR: https://github.com/ggerganov/ggml/pull/900

[leejet]

ggml submodule of sd.cpp is now ggerganov/ggml.