[BugFix] Modify max_tokens and modify the log and fix #1103

[amy-why-3459]

PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.

Purpose

Fix #1099

Test Plan

vllm serve Qwen/Qwen3-Omni-30B-A3B-Instruct 
     --omni 
     --port 8091 
     --stage-configs-path /vllm_omni/model_executor/stage_configs/qwen3_omni_moe_async_chunk.yaml

Test Result

{'type': 'request_level_metrics',
  'request_id': 'chatcmpl-9635776e7401b703',
  'e2e_time_ms': 15611.124753952026,
  'e2e_tpt': 6.048479176269673,
  'e2e_total_tokens': 2581,
  'transfers_total_time_ms': 0.0,
  'transfers_total_bytes': 0,
  'stages': {0: {'stage_gen_time_ms': 75.16026496887207,
                 'num_tokens_out': 90,
                 'num_tokens_in': 2491},
             2: {'stage_gen_time_ms': 213.80853652954102, 'num_tokens_out': 0}}}
 [Summary] {'e2e_requests': 1,
  'e2e_total_time_ms': 15611.555576324463,
  'e2e_sum_time_ms': 15611.124753952026,
  'e2e_total_tokens': 2581,
  'e2e_avg_time_per_request_ms': 15611.124753952026,
  'e2e_avg_tokens_per_s': 165.33081636841115,
  'wall_time_ms': 15611.555576324463,
  'final_stage_id': 2,
  'stages': [{'stage_id': 0,
              'requests': 1,
              'tokens': 2581,
              'total_time_ms': 10248.541831970215,
              'avg_time_per_request_ms': 10248.541831970215,
              'avg_tokens_per_s': 251.8407049819125},
             {'stage_id': 1,
              'requests': 1,
              'tokens': 328,
              'total_time_ms': 6840.2392864227295,
              'avg_time_per_request_ms': 6840.2392864227295,
              'avg_tokens_per_s': 47.95153886663746},
             {'stage_id': 2,
              'requests': 1,
              'tokens': 0,
              'total_time_ms': 6722.139120101929,
              'avg_time_per_request_ms': 6722.139120101929,
              'avg_tokens_per_s': 0.0}]}
the request e2e is: 20.947600789368153
the avg e2e is: 20.947600789368153

---

Essential Elements of an Effective PR Description Checklist

• The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
• The test plan, such as providing test command.
• The test results, such as pasting the results comparison before and after, or e2e results
• (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
• (Optional) Release notes update. If your change is user facing, please update the release notes draft.

BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)

[hsliuustc0106]

is this model specific?

[hsliuustc0106]

add test results

[david6666666]

@codex review

[chatgpt-codex-connector]

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 0d8e9d8679

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

• Open a pull request for review
• Mark a draft as ready
• Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

[chatgpt-codex-connector]

Clean up per-chunk lock files to avoid /dev/shm leaks

This change creates a new lock file under /dev/shm for every put_key (request+stage+chunk) but there is no corresponding deletion anywhere in the connector. On long-running servers or high‑throughput workloads, these lock files will accumulate indefinitely and can exhaust /dev/shm inode/space limits, which will then cause future SHM writes/locks to fail. This only happens when many chunks are produced, but it’s a realistic production scenario for streaming workloads.

Useful? React with 👍 / 👎.