UniEon

Results 11 comments of UniEon

Result for `lxc remote list`: ``` +-----------------+------------------------------------------+---------------+-------------+--------+--------+--------+ | NAME | URL | PROTOCOL | AUTH TYPE | PUBLIC | STATIC | GLOBAL | +-----------------+------------------------------------------+---------------+-------------+--------+--------+--------+ | images | https://images.linuxcontainers.org | simplestreams...

Facing the same issue on self hosted LLM running gemma-2-9B-Instruct with fastchat and sglang worker, which works when token is set to 512 but timeout when max_token is 2000. When...

If you use 4x4060ti the speed of inference might be slow given the communication overhead between the GPU's (not tried a benchmark but just based on theoretical knowledge). If you...

No Probably wrote by mistake its 22.04.4, as mentioned in the issue when I run it again it works. Issue is this problem comes every time an upgrade is done...

> `openai.InternalServerError: 504 Gateway Time-out` seems to occur from large prompts. can you verify how long the `blog` is before it is sent for proofreading? If you see the program...

I was just checking the stop id's Isn't it looking at the tokenizer the stop id's for glm-4 are: 151329, 151336, 151338

> Thanks, PR is also welcomed if you are interested. Done. Submitted the pull request. #2376

@qinxuye This needs to be reopened as pull request #2376 is not yet merged.

I can give you the rts file which below: ``` // professional.rts // This stylesheet defines a complete document template by importing article.rts. // article.rts is a standard Rinohtype document...

@brechtm Thanks for pointing out the errors and I should have gone through in details with manual and reference guid instead of falling prey to LLM output by providing them...