Chang W. Lee
Chang W. Lee
The necessary files have been modified for the latest flutter 3.
I wrote a code that adds a simple chat history to the prompt. There may be a better implementation, but I made it simple by modifying only chain_wrapper.py. Even if...
I got following errors on your demo page. ``` Find an error initializing the WebGPU device Error: Cannot find adapter that matches the request Init error, Error: Find an error...
lcw99/polyglot-en-12.8b-chang-instruct-chat Add support for this model, which is based on EleutherAI's Polyglot 12.8b and is the largest publicly available Korean model. This model has been fine-tuned to follow Korean instructions.
Try to run nueral_compressor/language_modeling, as follows. it just same as on read.me. I have 24G GPU, but cause GPU OOM. This model is only 125M, is it normal? How much...
When I call multiple streaming completions at the same time I get the error below. ``` start listening on 127.0.0.1:8888 ERROR:waitress:Exception while serving /v1/completions Traceback (most recent call last): File...
When using the SHORTEST_QUEUE method for load balancing, an issue arises because the queue_length isn't updated when a generation task ends. This leads to inaccurate load balancing across worker processes....