JP comments

Repositories
Issues
Comments

Results 3 comments of

JP

gptSessionBenchmark Failed Because of " Assertion failed: d == a + length " with 0.7.1 Release in tritonserver:23.12-trtllm-python-py3 Image

Hi there, I'm facing the same issue and am kinda new to the whole build process. I was also wondering what is the recommended way to verify one's own tensorRT-LLM/triton-inference-serve/tensorrtllm_backend...

gptSessionBenchmark Failed Because of " Assertion failed: d == a + length " with 0.7.1 Release in tritonserver:23.12-trtllm-python-py3 Image

Hi @byshiue sorry I realised I made a mistake by not checking out the right tag in the TensorRT-LLM repository and ended up building off the wrong branch version. Checking...

Gradient accumulation yields worse results than the equivalent batch size

Kudos @danielhanchen on the fix! Neat write-up as well! Back to the OP, I think the issue isn't with the `trl` library, but with the `transformers` library instead, because of...