stable-diffusion.cpp icon indicating copy to clipboard operation
stable-diffusion.cpp copied to clipboard

Suggestion: simple one-call function to make stable-diffusion.dll accessible for newbie coders

Open JohnClaw opened this issue 1 year ago • 0 comments

Recently i discovered Dllama.dll ( https://github.com/tinyBigGAMES/Dllama ), lib that allows to chat with llm ggufs using only one simple function call. For example, i call it from my AutoIt script like this:

Local $hDLL = DllOpen("Dllama.dll") Local $answer = DllCall($hDLL, "str:cdecl", "Dllama_Simple_Inference", "str", "C:\LLM\gguf\", "str", "models2.json", "str", "llama3:8B:Q6", "boolean", False, "uint", 1024, "int", 27, "str", $question) DllClose($hDLL)

So it's very attractive for novice coders because doesn't require knowledge about advanced coding technics like pointers, structures etc which are used in original llama.dll from llama.cpp repo making it not newbie-friendly.

Could you add such simple function to stable-diffusion.dll, please?

JohnClaw avatar May 06 '24 01:05 JohnClaw