feat(responses): pluggable ResponseStore abstraction#35905

Open

will-deines wants to merge 14 commits intovllm-project:mainfrom

will-deines:feat/pluggable-response-store

Commits on Mar 18, 2026

feat(responses): stateless multi-turn via encrypted_content (RFC #26934)

garrio-1
and
claude
committed
fix(responses): cancel_responses stateless mode — 404 on unknown id, 400 on success, info log

garrio-1
and
claude
committed
fix+test: address code review feedback (cancel error codes, missing carrier guard, background invariant)
garrio-1
committed
fix: incomplete carrier history, unconditional carrier guard, short key validation
garrio-1
committed
fix: remove unused TYPE_CHECKING import to pass pre-commit ruff check
garrio-1
committed
feat(responses): pluggable ResponseStore abstraction
garrio-1
committed
fix: guard message store access with lock in InMemoryResponseStore
garrio-1
committed
fix: use rsplit for more robust state carrier parsing
garrio-1
committed
style: fix ruff-format slice spacing in state carrier parsing
garrio-1
committed
fix: remove local_test/ from .gitignore
garrio-1
committed
Merge branch 'main' into feat/pluggable-response-store
will-deines
authored
fix: address PR #35905 review comments (double-include, tampered carrier, cross-replica streaming)
garrio-1
committed

Commits on Mar 20, 2026

Merge upstream/main and resolve conflict in responses/utils.py
garrio-1
committed

Commits on Mar 24, 2026

Merge remote-tracking branch 'upstream/main' into feat/pluggable-response-store
garrio-1
committed