Adam Clark
Adam Clark
What if we wrote a bunch of delegates as a sort of wrapped API, and use `LoadLibrary` to swap dll's out during runtime However the performance hit could be heavy,...
Just support for swapping would be handy, I am one of the few that run LLamaSharp on servers with GPUs but don't want to use GPU's as they are busy...
You may have to check the `ASPNETCORE_ENVIRONMENT` environment variable is set correctly on the server or it will try use the `appsettings.Development.json` https://learn.microsoft.com/en-us/aspnet/core/fundamentals/environments?view=aspnetcore-8.0 And double check your `launchSettings.json` make sure...
> Hello and thanks for this great project! > > I've attempted to add an init image to the pipeline, but it ends up just becoming a blur no matter...
`UNET` conversion succeeds, however produces and error on the inference run Error Log: ``` [2024-04-20 15:12:03,805] [DEBUG] [ort_inference.py:111:get_ort_inference_session] Normalized providers: ['DmlExecutionProvider'], provider_options: [{}] 2024-04-20 15:12:16.4887444 [E:onnxruntime:, sequential_executor.cc:514 onnxruntime::ExecuteKernel] Non-zero status...
> Looks cool. How is the text generation speed for onnx models compared to llamasharp for a Mistral 7B v0.2 Instruct model for example? Im not too sure, I have...
The LLamaStack WebApi supports most of LLamaSharp features including state saving etc https://api.llama-stack.com/swagger/index.html Adding a new controller to map the different json inputs outputs should be trivial, assuming there is...
Hi JranZu, I am currently still working on the `StableDiffusion3` and `FluxPipline`, This can take a bit of time as I can't create the pipeline until I successfully convert the...
Hey JacobCZ The `CUDA` and `TensorRT` OnnxRuntime packages require their own dependencies to be installed, `CUDA Toolkit` and `cuDNN` `LoadLibrary failed with error 126 ` happens when it cant find...
Hey Everyone, I am currently still working on the `StableDiffusion3` and `FluxPipline`, This can take a bit of time as I can't create the pipeline until I successfully convert the...