yan-virin issues

Repositories
Issues
Comments

Results 1 issues of


                                            yan-virin

bug: Requests with "use_beam_search: true" fail with an unclear exception message.

### Describe the bug I am using this llm config in the json request: "llm_config": { "num_beams": 5, "use_beam_search": true } and I am getting an unclear exception: chatx-gdch-openllm-86d68dd84f-r8png RuntimeError:...