-
Notifications
You must be signed in to change notification settings - Fork 425
Closed
Labels
doneWork on this issue is complete.Work on this issue is complete.questionFurther information is requestedFurther information is requested
Description
Using a slow image processor as use_fast is unset and a slow processor was saved with this model. use_fast=True will be the default behavior in v4.50, even if the model was saved with a slow processor. This will result in minor differences in outputs. You'll still be able to use a slow processor with use_fast=False.
另外上图的 两个警告,不处理影响性能么
lmdeploy / vllm / transformers
哪一种推理速度更快
Metadata
Metadata
Assignees
Labels
doneWork on this issue is complete.Work on this issue is complete.questionFurther information is requestedFurther information is requested
