Skip to content

Commit 7edb89a

Browse files
committed
[FDConfig] Disable overlap schedule by default
1 parent d70f33d commit 7edb89a

1 file changed

Lines changed: 4 additions & 0 deletions

File tree

fastdeploy/config.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2168,6 +2168,10 @@ def postprocess(self):
21682168
"Static Graph does not support to be started together with RL Training, and automatically switch to dynamic graph!"
21692169
)
21702170

2171+
# Disable overlap schedule in RL. This will be enabled in the future after bugs are fixed.
2172+
if self.load_config is not None and self.load_config.dynamic_load_weight is True:
2173+
self.scheduler_config.enable_overlap_schedule = False
2174+
21712175
# Layer-by-layer swap (H2D) is always incompatible with CUDA Graph prefill capture.
21722176
# Force only decode to use CUDA Graph when host cache is configured.
21732177
if (

0 commit comments

Comments
 (0)