Eric O Meehan
Eric O Meehan
It would also be nice if there were a setting to automatically unload models when they are unused for a period of time.
``` LOCALAI_WATCHDOG_IDLE=true LOCALAI_WATCHDOG_IDLE_TIMEOUT=15m ``` With these set as shown the application is unloading things properly for me now.
This is a work in progress that I meant to open on my fork of the repo. I haven't tested it yet. I closed it when I noticed the mistake,...
This is working for my machines using either repo, though I haven't tested more bespoke configurations.
I'm seeing the same thing on Debian 12 with v3.0.6-5.