InferenceMAX
InferenceMAX copied to clipboard
Perfetto SGLang profiler trace during CI to make it easier to improve perf
as per lmsys xai sglang suggestion,
https://github.com/sgl-project/sglang/actions/runs/18701520115/job/53331131552#step:4:402. prefer get the full log from start to shutdown. For the profilers, we are looking for torch profiles How to generate: https://docs.sglang.ai/developer_guide/benchmark_and_profiling.html#profile-a-server-with-sglang-profiler> Examples files: https://github.com/sglang-bot/sglang-ci-data/tree/main/traces/18701520115
https://github.com/sgl-project/sglang/blob/ddd1440d0f027e85af6be53bbb309683ed7ea2c4/.github/workflows/nightly-test.yml#L49-L64