fix: context cancellation handling

[sivchari]

Checklist:

• Either (a) I've created an enhancement proposal and discussed it with the community, (b) this is a bug fix, or (c) this does not need to be in the release notes.
• The title of the PR states what changed and the related issues number (used for the release note).
• The title of the PR conforms to the Toolchain Guide
• I've included "Closes [ISSUE #]" or "Fixes [ISSUE #]" in the description to automatically close the associated issue.
• I've updated both the CLI and UI to expose my feature, or I plan to submit a second PR with them.
• Does this PR require documentation updates?
• I've updated documentation as required by this PR.
• I have signed off all my commits as required by DCO
• I have written unit and/or e2e tests for my change. PRs without these are unlikely to be merged.
• My build is green (troubleshooting builds).
• My new feature complies with the feature status guidelines.
• I have added a brief description of why this PR is necessary and/or what this PR solves.
• Optional. My organization is added to USERS.md.
• Optional. For bug fixes, I've indicated what older releases this fix should be cherry-picked into (this may or may not happen depending on risk/complexity).

Currently, isCanceledContextErr can only handle the context.Canceled and gRPC status when the communication is hung up. So if first communication is succeeded, then second communication passed context that has already been deadline exceeded, the loop is no longer break since the context.DeadlineExceeded isn't considered. So I made it consider the context.DeadlineExceeded.

[bunnyshell]

❌ Preview Environment deleted from Bunnyshell

Available commands (reply to this comment):

• 🚀 /bns:deploy to deploy the environment

[codecov]

Codecov Report

❌ Patch coverage is 0% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 56.11%. Comparing base (db9c82a) to head (eb78ade).
⚠️ Report is 632 commits behind head on master.

Files with missing lines	Patch %	Lines
pkg/apiclient/apiclient.go	0.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master   #22824      +/-   ##
==========================================
+ Coverage   56.06%   56.11%   +0.04%     
==========================================
  Files         343      343              
  Lines       57545    57545              
==========================================
+ Hits        32262    32289      +27     
+ Misses      22633    22612      -21     
+ Partials     2650     2644       -6     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[crenshaw-dev]

@sivchari is this something we could test? Obviously we could unit test the function, but something more end-to-end would be nice if possible.

[sivchari]

@crenshaw-dev
This bug was found while working on #21963 .

The following 2 test has already tested this function on e2e, then these are sometime stuck since the deadline doesn't be handled. I tried to reproduce on my machine, but it's difficult to reproduce since this failure is important for timing.
IMO, it's good to check on ut. What do you think ?

• https://github.com/argoproj/argo-cd/blob/master/test/e2e/app_management_ns_test.go#L1347
• https://github.com/argoproj/argo-cd/blob/master/test/e2e/app_management_test.go#L1839

[ishitasequeira]

LGTM! @crenshaw-dev are we good to merge this?