Skip to content

【Hackathon 7th No.43】完善 TokenizerFast 功能支持 part 5#9594

Merged
DrownFish19 merged 3 commits into
PaddlePaddle:developfrom
FlamingoPg:add_ernie_tk
Dec 12, 2024
Merged

【Hackathon 7th No.43】完善 TokenizerFast 功能支持 part 5#9594
DrownFish19 merged 3 commits into
PaddlePaddle:developfrom
FlamingoPg:add_ernie_tk

Conversation

@FlamingoPg
Copy link
Copy Markdown
Contributor

PR types

New features

PR changes

Others

Description

添加Ernie TokenizerFast
Reference:https://github.com/rogerdehe/transformers-ernie/tree/main

@paddle-bot
Copy link
Copy Markdown

paddle-bot Bot commented Dec 9, 2024

Thanks for your contribution!

@FlamingoPg
Copy link
Copy Markdown
Contributor Author

cc:@DrownFish19

@codecov
Copy link
Copy Markdown

codecov Bot commented Dec 9, 2024

Codecov Report

Attention: Patch coverage is 83.33333% with 9 lines in your changes missing coverage. Please review.

Project coverage is 53.05%. Comparing base (b205922) to head (2d73627).
Report is 257 commits behind head on develop.

Files with missing lines Patch % Lines
paddlenlp/transformers/ernie/tokenizer_fast.py 72.72% 9 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #9594      +/-   ##
===========================================
+ Coverage    52.74%   53.05%   +0.31%     
===========================================
  Files          708      709       +1     
  Lines       111166   111601     +435     
===========================================
+ Hits         58629    59215     +586     
+ Misses       52537    52386     -151     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@FlamingoPg
Copy link
Copy Markdown
Contributor Author

@DrownFish19 CI看起来都过了哈,麻烦再帮忙review下~

Copy link
Copy Markdown
Collaborator

@DrownFish19 DrownFish19 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@DrownFish19 DrownFish19 merged commit f445a7a into PaddlePaddle:develop Dec 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants