Michael
Michael
Nope - not really. I'm running on an older CPU without issues, but you might be missing a little RAM - if your screenshot is without running a model
> you're right, I noticed strange behavior while using the template. The swap memory (usually 12gb) is in 90% beyond the memory itself ram (4gb) totaling 16gb. I think I...
> Memory is pretty straightforward (from the docs): > > 7B => ~4 GB 13B => ~8 GB 30B => ~16 GB 65B => ~32 GB > > Those are...
> I saw in another personal forum saying that there was slowness with docker. Are you running with or without docker? I'm running in the docker compose setup provided here....
Ok, as promised I set dalai up using docker on my Server - 1x Intel(R) Xeon(R) CPU E5-4620 v4 @ 2.10GHz - 64 GB RAM - ubuntu 22.04 with 5.15.0-69...
Hey so i did some more experimenting @dgasparri :) | threads | input token | output token | output chars | time including model loading | Tokens/s | | ---...
Hey, think there is already an issue #181 open with your request :)
Uhm - it's just a guess but since you are in the agent class, you can't tell that you are currently return the exact class. Therefore "Agent" to hit at...
@joaomdmoura, would be nice if you could have look - cheers
After looking into the specs for the hierarchical process I'll close this PR, since hierarchical does nearly the same :D