Feature description
Add a test that enables and uses the Torch Profiler support in vLLM, including with the Kineto extension for IBM Spyre.
Motivation and context
The changes for the v0.16.0 vLLM upgrade in #778 affected how the Torch profiler is configured. This surfaced a gap that we don't have a test for the profiler integration.
Proposed solution
We need to publicly installable wheels from kineto-spyre. There are pre-release wheels published to the releases page; however, the x86_64 wheels are currently built for Python 3.13 and we are still using 3.12 in our images...
Checklist
Feature description
Add a test that enables and uses the Torch Profiler support in vLLM, including with the Kineto extension for IBM Spyre.
Motivation and context
The changes for the v0.16.0 vLLM upgrade in #778 affected how the Torch profiler is configured. This surfaced a gap that we don't have a test for the profiler integration.
Proposed solution
We need to publicly installable wheels from kineto-spyre. There are pre-release wheels published to the releases page; however, the x86_64 wheels are currently built for Python 3.13 and we are still using 3.12 in our images...
Checklist