Skip to content

[Frontend] Warn if user max_model_len is greater than derived max_model_len#7080

Merged
njhill merged 7 commits intovllm-project:mainfrom
fialhocoelho:warning-max-seq-len
Aug 3, 2024
Merged

[Frontend] Warn if user `max_model_len` is greater than derived `max_model_len`#7080
njhill merged 7 commits intovllm-project:mainfrom
fialhocoelho:warning-max-seq-len

Commits

Commits on Aug 2, 2024

Commits on Aug 3, 2024