Tobi issues

Repositories
Issues
Comments

Results 1 issues of


                                            Tobi

Adaptive batching leads to parameters being cut off

Hi, I observed some weird behavior when using the REST API with adaptive batching enabled. When sending a **single** request to the v2 REST endpoint `/v2/models//infer` the Parameters within the...