erick comments

Repositories
Issues
Comments

Results 2 comments of


                                            erick

How do we stop a model to release GPU memory? (not ollama server).

@technovangelist can I modify the offloading time somewhere in the code?

How do we stop a model to release GPU memory? (not ollama server).

> @technovangelist can I modify the offloading time somewhere in the code? Figured out: ollama/server/routes.go var defaultSessionDuration = 5 * time.Minute