dm4

[WASI-NN] ggml: add llava support

2

- Add `mmproj` and `image` options. - Refactor inference code, separate evaluation and prediction. - Related example PR https://github.com/second-state/WasmEdge-WASINN-examples/pull/97

feat: ggml: support more parameters from llama.cpp

4

### Summary We currently support some parameters from llama.cpp, such as `n_gpu_layers`, `cox-size`, `thread`, etc., and we expect to support even more parameters. ### Details Refer to [llama.cpp/common/common.cpp/gpt_params_find_arg()](https://github.com/ggerganov/llama.cpp/blob/master/common/common.cpp#L160), planning to...

This PR is for https://github.com/WasmEdge/WasmEdge/issues/1981

WASI-NN: Add new backends and discuss the corresponding index

9

### Summary Since the WasmEdge WASI-NN plugin is expected to continue adding more backends, an issue needs to be created to discuss the upcoming backends and decide their index in...

[WASI-NN] ggml: support compute single in RPC mode

2

As #3319, this PR adds support for `ComputeSingle`, `GetOutputSingle`, and `FiniSingle` in RPC mode for the ggml backend. - Add the `BackendError` to the proto file. - Add the `GGMLBackendComputeSingleWithRPC`...

[DO NOT MERGE UNTIL THE DISCUSSION IS DONE][Docs] Update security-related files

6

This pull request updates the security-related files according to the [CNCF tag-security templates](https://github.com/cncf/tag-security/tree/main/project-resources), including `SECURITY.md`, `docs/SECURITY_CONTACTS.md`, and `docs/embargo-policy.md`. However, we still have some items to be decided: #### `SECURITY.md` -...

feat: Provide `.framework` for macOS

10

### Summary Currently, WasmEdge provides a `.dylib` library on macOS. We aim to offer a `.framework` format library in the future. ### Details Possible reference documentation: [CMAKE_FRAMEWORK](https://cmake.org/cmake/help/latest/prop_tgt/FRAMEWORK.html) ### Appendix _No...

A demo for proxy-wasm

5

## Motivation Since WasmEdge is merged into [proxy-wasm-cpp-host](https://github.com/proxy-wasm/proxy-wasm-cpp-host) (https://github.com/proxy-wasm/proxy-wasm-cpp-host/pull/193), we need a simple demo to show our support on proxy-wasm. ## Details TBD

feat: Provide weekly/nightly builds of WasmEdge

1

### Summary Provide weekly/nightly builds of WasmEdge. ### Details In order to provide WasmEdge's weekly or nightly build, we should add some new CIs. Perhaps we can open a new...