Justin Pflueger

Yes! This is something I'm actively working on in a different repository [jpflueger/spin-llm-prompts](https://github.com/jpflueger/spin-llm-prompts). Right now I'm still adjusting the API to be compatible. Once I get the `completions` component in...

Just wanted to add my findings in here as well. It seems like there is a CPU spike during startup that is throttled by the resource limits. This might not...

> I'm still _strongly_ against this - magic names lead to much more confusion over time - and makes it harder for us to debug users environments. notably it also...

One thing to keep in mind here is that when setting resource requests/limits using the containerd shim, it drastically increases the time until the startup/readiness probes pass. So if we're...

I see this issue was closed but I was looking for the linux aarch64 binary today and couldn't find it in any of the release downloads. According the release notes,...

@vdice / @thomastaylor312 any update on this issue? Should I re-open it or file a new issue?

A `0.8.2` release is exactly what I need. We could also push a `v0.9.0-rc.2` release and I could test that out as well. Not sure when the next release for...