-
Notifications
You must be signed in to change notification settings - Fork 952
[azopenai] Fixing tests and re-enabling relevant recordings #25728
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[azopenai] Fixing tests and re-enabling relevant recordings #25728
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
This PR removes brittle assertions that checked for exact token counts in chat completion tests. The test now validates that token usage values are populated (greater than zero) rather than matching specific values, making the tests more resilient to model changes.
Key Changes:
- Replaced exact token count assertions with checks that verify token counts are positive values
- Removed model-specific hard-coded values that could cause test failures when models change
|
/azp run go - azopenai |
|
Azure Pipelines successfully started running 1 pipeline(s). |
…e, instead of the client.
|
/azp run go - azopenai |
|
Azure Pipelines successfully started running 1 pipeline(s). |
…e is now mostly models (and serde), and the majority of the code is in an external client (ie, openai-go).
|
/azp run go - azopenai |
|
Azure Pipelines successfully started running 1 pipeline(s). |
…deprecated, and we don't have a replacement. We can (and will) continue to test with recordings for now, just to make sure the code is correct.
|
/azp run go - azopenai |
|
Azure Pipelines successfully started running 1 pipeline(s). |
Fixes #25727