Add the missing truncation=True in llm/predictor.py

[lszxb]

PR types

Bug fixes

PR changes

Others

Description

In llm/predictor.py, two calls to tokenizer are missing the truncation=True parameter, causing the results not to be truncated to max_length. This leads to errors in subsequent processing when using --benchmark for testing. This PR fixes this issue.

[paddle-bot]

Thanks for your contribution!

[CLAassistant]

All committers have signed the CLA.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 55.50%. Comparing base (5a508e5) to head (0e2f97c).
Report is 216 commits behind head on develop.

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #8768      +/-   ##
===========================================
+ Coverage    55.43%   55.50%   +0.07%     
===========================================
  Files          626      626              
  Lines        98070    98070              
===========================================
+ Hits         54366    54437      +71     
+ Misses       43704    43633      -71     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[vivienfanghuagood]

Approved

[DesmonDay]

LGTM