eeeeeunjung

> Hi @eeeeeunjung, can you confirm this behavior also occurs in the 23.12 release as well? > > CC; @tanmayv25 for vis oh sorry, i have no machine to test...

it seems each model has a request queue, when a request enters the queue waiting for serial processing, cancellation cannot cancel the current request status. The status will only be...

i make a python backend like this ``` def execute(self, requests): responses = [] for request in requests: if request.is_cancelled(): responses.append( pb_utils.InferenceResponse( error=pb_utils.TritonError("Request Cancelled", pb_utils.TritonError.CANCELLED) ) ) continue request_type =...

and when i use BLS, i can only cancel the outer request, i can not cancel the sub request sent in the bls's execute function

我是2234放在最后边，2234骑着马太高了，挡着石头了，完全开始不了，一直说找不到oil icon