-
Notifications
You must be signed in to change notification settings - Fork 53
Add torch resolution to old plugin #783
Copy link
Copy link
Open
Labels
May2026enhancementNew feature or requestNew feature or requestvllm-spyre-oldRelated to the continued maintenance of the old `vllm-spyre` plugin on the `torch_sendnn` stack.Related to the continued maintenance of the old `vllm-spyre` plugin on the `torch_sendnn` stack.
Metadata
Metadata
Assignees
Labels
May2026enhancementNew feature or requestNew feature or requestvllm-spyre-oldRelated to the continued maintenance of the old `vllm-spyre` plugin on the `torch_sendnn` stack.Related to the continued maintenance of the old `vllm-spyre` plugin on the `torch_sendnn` stack.
Type
Projects
Status
Backlog
Feature description
For the 2.0 release, we should consider enabling real dependency resolution for torch
Motivation and context
Given the work to validate the torch_sendnn runtime stack on newer versions of torch, and the confusion caused to users by not including torch in dependency resolution and instead using the system torch install from a base image, we should probably declare torch as a real dependency and resolve it along with our other dependencies.
The locked version can stay at whatever specific torch version we've validated the runtime stack on, and we'll have helpful build failures to remind us when we need to revalidate with a newer torch version. This would be preferable than having our users complain when their builds start failing.
Proposed solution
We can pull over the pyproject.toml snippets from vllm-spyre-next that:
VLLM_TARGET_DEVICEto the builds to ensure we don't compile other device kernelsand pin the torch version to 2.10 for the 2.0 release
Checklist