Picus303
Picus303
@Maximilian-Winter Do you have an example? A sample or a list of dependencies? I tried using your fork (for guidance) but just importing it raises an error. I fixed a...
is there any updates on the matter? maybe something on the current state of the project?
@cjatin Thanks for your advices. I'll try. > Threadpool on GPU might not be the best fit (design wise). I'm not knowledgeable enough to understand why. Could you please elaborate?
might be my fault, I'll investigate this
Seams weird. Can I have the full trace please?
btw, can someone please tell me why there are three files `api.py`, `postapi.py` and `msgpack_api.py` ? I want to be sure to understand.
> > btw, can someone please tell me why there are three files `api.py`, `postapi.py` and `msgpack_api.py` ? I want to be sure to understand. > > `api.py`: Server `post_api.py`:...
Almost done! It seems to be working... There's just the code for the agent which is a nightmare to deal with. I'll try to finish it this friday/saturday (timezones). Technically,...
> Wonder if we can customize the `temperature` and `top_p` parameter for web server? - If you mean the WebUI: Yes, from the UI - If you mean the API:...
I need to ask about the agent: this thing is a bit confusing. I understand that internally, the agent uses the API to work, that's ok for me BUT: 2...