Skip to content

Conversation

@NeroLoh
Copy link
Contributor

@NeroLoh NeroLoh commented Feb 5, 2024

PR types

New features

PR changes

OPs

Description

对齐ernie模型中paddle lite量化相关功能:

  1. SoftmaxMax: https://github.com/PaddlePaddle/Paddle-Lite/pull/10392/files
  2. SmoothQuant: [xpu] support SmoothQuant;test=develop Paddle-Lite#10359
  3. SkipQuant + LocalQuant: [XPU] support skip quant and xpu local quant Paddle-Lite#9399
  4. QUANT_GELU_OUT_THRESHOLD功能
  5. 默认关闭quant_dequant_xpu_pass,该pass只针对旧格式的int8模型,需要时用户自行打开

@paddle-bot
Copy link

paddle-bot bot commented Feb 5, 2024

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@paddle-bot paddle-bot bot added the contributor External developers label Feb 5, 2024
@NeroLoh NeroLoh force-pushed the support_quant branch 2 times, most recently from 115b639 to d8cb4ef Compare February 5, 2024 08:42
risemeup1
risemeup1 previously approved these changes Feb 5, 2024
Copy link
Contributor

@zhupengyang zhupengyang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zhupengyang zhupengyang merged commit bd281c9 into PaddlePaddle:develop Feb 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

contributor External developers

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants