pcastonguay

chore: Refactor disaggregated serving scripts

19

To simplify disaggregated serving deployment and reduce duplicated code, the disaggregated workers and server can now be launched with: ``` python3 ${EXAMPLE_DIR}/launch_disaggregated_workers.py -c ${CONFIG_FILE} trtllm-serve disaggregated -c ${CONFIG_FILE} ``` respectively,...

[feat][TRTLLM-5018] Dis serving python runtime trt backend

19

# PR title ## Description Adds support for TRT backend when running disaggregated serving with trtllm-serve ## Test Coverage ## GitHub Bot Help `/bot [-h] ['run', 'kill', 'skip', 'reuse-pipeline'] ...`...

[https://nvbugs/5680310][fix]Fix ctx only timed out test

4

## Summary by CodeRabbit * **Improvements** * Enhanced timeout messaging for KV cache transfer operations. * **Tests** * Updated KV cache transfer backend configuration in test cases. * Re-enabled previously...