Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Darwin Build_Release failure on Helix tests - Tests timing out #40074

Open
MiYanni opened this issue Apr 9, 2024 · 7 comments
Open

Darwin Build_Release failure on Helix tests - Tests timing out #40074

MiYanni opened this issue Apr 9, 2024 · 7 comments
Labels
Area-Infrastructure Area-Watch Known Build Error untriaged Request triage from a team member

Comments

@MiYanni
Copy link
Member

MiYanni commented Apr 9, 2024 •
edited by build-analysis bot
Loading

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799
Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution
Pull request: #40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799
Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build Definition Test Pull Request
847885 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #44314
2564127 dotnet-sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43933
2563973 dotnet-sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43992
2563744 dotnet-sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43925
846447 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44014
846363 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44207
846222 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44266
846135 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44265
846057 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44153
845795 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #44256
2562589 dotnet-sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43836
845370 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.2.WorkItemExecution #44247
845359 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution
2562302 dotnet-sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43135
845043 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44238
844221 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #44008
844327 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44187
844035 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44190
844220 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #44155
844218 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44148
844093 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44181
844038 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #44191
2561365 dotnet-sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43134
843962 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44207
843807 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44201
843821 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43607
843541 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #44175
843429 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43627
843389 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44153
843259 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44191
842653 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44008
842026 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44148
842245 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43015
841945 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43988
841827 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44153
841801 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44154
841271 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44008
840620 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution #44008
840086 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution
839882 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution #44108
839912 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43239
839427 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #44085
839071 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44084
838326 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.2.WorkItemExecution #44065
838275 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44027
838031 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution #44067
837980 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44014
837700 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution #44008
836065 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44001
834134 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44003
833084 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43954
832483 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43978
832660 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43986
832497 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43979
831722 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43962
831160 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43909
2554989 dotnet-sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43133
830023 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43884
829897 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43673
829894 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43887
829847 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43943
828054 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43357
828056 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43362
827675 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43884
826254 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43849
826009 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43863
824873 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43840
825837 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43860
825469 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution
823043 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43690
822223 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43085
821479 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43779
821348 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43776
819459 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43731
819363 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43728
819230 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43724
819073 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43416
819013 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43712
818182 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43514
817770 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43681
817474 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43672
817216 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43555
816891 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43541
2545401 dotnet-sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43090
814811 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43416
813806 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43547
813521 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43585
2542439 dotnet-sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43039
812799 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43491
812664 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43547
812573 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43456
812416 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43558

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
4 38 92
@dotnet-issue-labeler dotnet-issue-labeler bot added Area-Infrastructure untriaged Request triage from a team member labels Apr 9, 2024
@ericstj ericstj mentioned this issue May 20, 2024
Merged
@nagilson
Copy link
Member

@tmat May you please look at this dotnet watch failure?

@tmat
Copy link
Member

tmat commented May 20, 2024 •
edited
Loading

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

@nagilson
Copy link
Member

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

@nagilson
Copy link
Member

We also just hit it in main, so there might be another existing problem: #41045

@ViktorHofer ViktorHofer mentioned this issue Jun 20, 2024
Merged
@ellahathaway ellahathaway mentioned this issue Jul 2, 2024
Closed
@baronfel
Copy link
Member

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

@tmat
Copy link
Member

tmat commented Aug 15, 2024

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

@baronfel
Copy link
Member

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Area-Infrastructure Area-Watch Known Build Error untriaged Request triage from a team member
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@tmat @baronfel @MiYanni @nagilson