File upload failed even after retry

[jeffschwMSFT]

Build

https://dev.azure.com/dnceng/internal/_build/results?buildId=2365835

Error:

Fail to upload '/mnt/vss/_work/1/a/IntermediateArtifacts/MonoRuntimePacks/Shipping/Microsoft.NETCore.App.Ref.9.0.0-preview.2.24080.4.symbols.nupkg' due to 'Bad Request'.
Microsoft.VisualStudio.Services.WebApi.VssServiceResponseException: Bad Request
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.HandleResponseAsync(HttpResponseMessage response, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.FileContainer.Client.FileContainerHttpClient.UploadFileAsync(Int64 containerId, String itemPath, Stream fileStream, Byte[] contentId, Int64 fileLength, Boolean isGzipped, Guid scopeIdentifier, CancellationToken cancellationToken, Int32 chunkSize, Int32 chunkRetryTimes, Boolean uploadFirstChunk, Object userState)
   at Microsoft.VisualStudio.Services.FileContainer.Client.FileContainerHttpClient.UploadFileAsync(Int64 containerId, String itemPath, Stream fileStream, Guid scopeIdentifier, CancellationToken cancellationToken, Int32 chunkSize, Boolean uploadFirstChunk, Object userState, Boolean compressStream)
   at Microsoft.VisualStudio.Services.Agent.Worker.Build.FileContainerServer.UploadAsync(IAsyncCommandContext context, Int32 uploaderId, CancellationToken token) in /home/vsts/work/1/s/src/Agent.Worker/Build/FileContainerServer.cs:line 250
Detail upload trace for file that fail to upload: IntermediateArtifacts/MonoRuntimePacks/Shipping/Microsoft.NETCore.App.Ref.9.0.0-preview.2.24080.4.symbols.nupkg

Chunk '2' attempt '1' of file 'IntermediateArtifacts/MonoRuntimePacks/Shipping/Microsoft.NETCore.App.Ref.9.0.0-preview.2.24080.4.symbols.nupkg' fail to send request to server. Error: Microsoft.VisualStudio.Services.Common.VssServiceException: TF203009: The size of the file that you uploaded does not match the size that the client computer provided.
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.HandleResponseAsync(HttpResponseMessage response, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.FileContainer.Client.FileContainerHttpClient.UploadFileAsync(Int64 containerId, String itemPath, Stream fileStream, Byte[] contentId, Int64 fileLength, Boolean isGzipped, Guid scopeIdentifier, CancellationToken cancellationToken, Int32 chunkSize, Int32 chunkRetryTimes, Boolean uploadFirstChunk, Object userState).

##[error]File upload failed even after retry.

Build leg reported

No response

Pull Request

No response

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "##[error]File upload failed even after retry",
    "BuildRetry": false,
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build	Repository	Step Name	Console log	Pull Request
1544433	dotnet/maui	publish artifacts	Log	dotnet/maui#37182
1542485	dotnet/maui	publish artifacts	Log	dotnet/maui#37143
1539633	dotnet/maui	publish artifacts	Log	dotnet/maui#37091
1538355	dotnet/maui	publish artifacts	Log	dotnet/maui#37069
1538235	dotnet/maui	publish artifacts	Log	dotnet/maui#37046
1537300	dotnet/maui	publish artifacts	Log	dotnet/maui#37035
1534217	dotnet/maui	publish artifacts	Log	dotnet/maui#36935
1532759	dotnet/maui	publish artifacts	Log	dotnet/maui#36820
1532558	dotnet/maui	publish artifacts	Log
1532282	dotnet/maui	publish artifacts	Log
1531653	dotnet/maui	publish artifacts	Log
1529485	dotnet/maui	publish artifacts	Log	dotnet/maui#36750
1529460	dotnet/maui	publish artifacts	Log	dotnet/maui#36676
1528129	dotnet/maui	publish artifacts	Log	dotnet/maui#36328
1525647	dotnet/maui	publish artifacts	Log	dotnet/maui#36773
1524728	dotnet/xharness	Build and run tests	Log	dotnet/xharness#1644
1524391	dotnet/xharness	Build and run tests	Log	dotnet/xharness#1642
1522572	dotnet/maui	publish artifacts	Log	dotnet/maui#35963
1521713	dotnet/maui	publish artifacts	Log
3028982	dotnet-maui	publish artifacts	Log
3028671	dotnet-runtime	🔒 Publish intermediate artifacts	Log
1519862	dotnet/maui	publish artifacts	Log
3028154	dotnet-runtime	🔒 Publish intermediate artifacts	Log
3027322	dotnet-maui	publish artifacts	Log
1517070	dotnet/maui	publish artifacts	Log
1516733	dotnet/maui	publish artifacts	Log	dotnet/maui#36654
1514501	dotnet/maui	publish artifacts	Log	dotnet/maui#36607
1512303	dotnet/maui	publish artifacts	Log	dotnet/maui#36243
1511960	dotnet/maui	publish artifacts	Log
1511908	dotnet/maui	publish artifacts	Log	dotnet/maui#36607
1511369	dotnet/maui	publish artifacts	Log	dotnet/maui#36513
1511676	dotnet/maui	publish artifacts	Log
1510467	dotnet/maui	publish artifacts	Log	dotnet/maui#36507
3023208	dotnet-maui	publish artifacts	Log
1509616	dotnet/maui	publish artifacts	Log
1508519	dotnet/maui	publish artifacts	Log	dotnet/maui#29952
3022400	dotnet-runtime	🔒 Publish intermediate artifacts	Log
1508108	dotnet/maui	publish artifacts	Log	dotnet/maui#36476
1508122	dotnet/maui	publish artifacts	Log	dotnet/maui#36427
1506992	dotnet/maui	publish artifacts	Log	dotnet/maui#36413
3021432	dotnet-runtime	🔒 Publish intermediate artifacts	Log
1506135	dotnet/maui	publish artifacts	Log
3020456	dotnet-runtime	🔒 Publish intermediate artifacts	Log
1504722	dotnet/maui	publish artifacts	Log	dotnet/maui#36429
1503734	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#130450
3019450	dotnet-maui	publish artifacts	Log
1503045	dotnet/maui	publish artifacts	Log

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	6	47

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng/internal/_build/results?buildId=2365835
Error message validated: [##[error]File upload failed even after retry]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/7/2024 2:03:27 AM UTC

[lewing]

This is often an from multiple lanes attempting to upload the same artifact

[markwilkie]

@lewing is right - there's usually not a whole lot dnceng can do to help.

[missymessa]

@jeffschwMSFT @lewing is this still an issue?

[lewing]

@jeffschwMSFT @lewing is this still an issue?

It still happens but it is typically a (mostly harmless) repository issue. Perhaps this issue should be updated to explain the cause and suggest fixes. It is clearly a recurring problem.