Skip to content

Commit fee7c0b

Browse files
liyonghua0910sunlei1024
authored andcommitted
[BugFix] Fix incorrect create tensor condition when clearing mtp cache (PaddlePaddle#7725)
1 parent d209877 commit fee7c0b

1 file changed

Lines changed: 1 addition & 2 deletions

File tree

fastdeploy/spec_decode/mtp.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -428,8 +428,7 @@ def clear_mtp_cache(self, profile=False):
428428
Clear allocated cacheKV
429429
"""
430430
create_cache_tensor = profile or not (
431-
self.fd_config.cache_config.num_cpu_blocks > 0
432-
or self.fd_config.cache_config.kvcache_storage_backend
431+
self.fd_config.cache_config.kvcache_storage_backend
433432
or self.fd_config.scheduler_config.splitwise_role != "mixed"
434433
)
435434
if not create_cache_tensor:

0 commit comments

Comments
 (0)