Skip to content

V100 lmdeploy 启动时 如何设置 use_fast=True #144

@zxh258147

Description

@zxh258147

Image

Using a slow image processor as use_fast is unset and a slow processor was saved with this model. use_fast=True will be the default behavior in v4.50, even if the model was saved with a slow processor. This will result in minor differences in outputs. You'll still be able to use a slow processor with use_fast=False.

另外上图的 两个警告,不处理影响性能么

lmdeploy / vllm / transformers

哪一种推理速度更快

Metadata

Metadata

Assignees

Labels

doneWork on this issue is complete.questionFurther information is requested

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions