Skip to content

fix the issue that: loading model consumes too much time test=decelop#2726

Merged
DannyIsFunny merged 3 commits into
PaddlePaddle:developfrom
DannyIsFunny:load_model_time
Jan 8, 2020
Merged

fix the issue that: loading model consumes too much time test=decelop#2726
DannyIsFunny merged 3 commits into
PaddlePaddle:developfrom
DannyIsFunny:load_model_time

Conversation

@DannyIsFunny
Copy link
Copy Markdown
Collaborator

@DannyIsFunny DannyIsFunny commented Jan 6, 2020

【问题描述】 Paddle-Lite加载模型时间过长,而且随着模型param文件的大小增长而线性增长明显。 当需要重复加载多个模型时,影响性能表现。
【解决方法】加载模型时naive_buffer结构体PrimaryListBuilder中保存的数据改为保存指针+size_,减少一次数据拷贝过程。
【PR效果】:降低模型加载时间,用28个基础模型测试修改后可以正常加载模型。

注:测试过的基础模型

  • 常用模型7个
    • mobileNetV1
    • mobileNetV2
    • mnasnet
    • resnet50
    • yolov3
    • ssd_mobilenetv1
    • unet
  • benchmark测试模型
    • squeezenet_v11
    • shufflenet_v2
  • int8模型
    • mobilenet_v1
    • mobilenet_v2
    • resnet50
  • 以上模型对应的x2paddle转化的tensorflow、caffe和onnx模型。

@DannyIsFunny DannyIsFunny merged commit 8e7906d into PaddlePaddle:develop Jan 8, 2020
@DannyIsFunny DannyIsFunny deleted the load_model_time branch January 8, 2020 04:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants