The Operation will be canceled. The next steps may not contain expected logs.

[tarekgh]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=696281

Build leg reported

Build / browser-wasm linux Release LibraryTests / Send to Helix

Pull Request

dotnet/runtime#103009

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The Operation will be canceled. The next steps may not contain expected logs.",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=696281
Error message validated: [The Operation will be canceled. The next steps may not contain expected logs.]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 6/4/2024 8:08:48 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
1391264	dotnet/aspnetcore	Run build.cmd helix target	Log	dotnet/aspnetcore#66331
1391244	dotnet/aspnetcore	Run build.cmd helix target	Log	dotnet/aspnetcore#65451
1391078	dotnet/runtime	Publish	Log	dotnet/runtime#126955
1391222	dotnet/aspnetcore	Run build.cmd helix target	Log	dotnet/aspnetcore#66418
1391190	dotnet/aspnetcore	Run build.cmd helix target	Log
1391182	dotnet/aspnetcore	Run build.cmd helix target	Log	dotnet/aspnetcore#66417
2957619	dotnet-runtime	Send to Helix	Log	#59556
1391177	dotnet/aspnetcore	Run build.cmd helix target	Log	dotnet/aspnetcore#66181
1390872	dotnet/maui	Controls WebView	Log
1390693	dotnet/runtime	Send tests to Helix (Unix)	Log
1391160	dotnet/sdk	🟣 Run TestBuild Tests	Log	dotnet/sdk#54040
1391102	dotnet/maui	Controls WebView	Log
1391092	dotnet/maui	Controls Layout	Log	dotnet/maui#35072
1391061	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#126953
1391127	dotnet/arcade	Run Helix Tests	Log	dotnet/arcade#16726
1390488	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127256
1389602	dotnet/maui	Controls WebView	Log	dotnet/maui#34600
2957474	dotnet-maui	Install dotnet preview workloads from PackageArtifacts	Log
1390979	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#126576
1389973	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127117
1391026	dotnet/aspnetcore	Run Quarantined Tests	Log	dotnet/aspnetcore#66383
1391023	dotnet/maui	Controls WebView	Log	dotnet/maui#35077
1391022	dotnet/maui	DeviceTestsMacCatalyst_CoreCLR (Windows)	Log	dotnet/maui#34758
1390990	dotnet/maui	Controls CollectionView	Log	dotnet/maui#34637
1389684	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127202
1390924	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127178
1390971	dotnet/maui	Controls WebView	Log	dotnet/maui#34632
1390768	dotnet/runtime	Send tests to Helix (Unix)	Log
1390864	dotnet/runtime	Send to Helix	Log	dotnet/runtime#122093
1390615	dotnet/maui	Controls WebView	Log	dotnet/maui#34614
1390776	dotnet/runtime	Run Native AOT Test App Tests	Log	dotnet/runtime#127268
1390890	dotnet/aspnetcore	Run Quarantined Tests	Log	dotnet/aspnetcore#61667
1390758	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#126150
1390745	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#127074
1390512	dotnet/runtime	Send tests to Helix (Unix)	Log
1390653	dotnet/maui	Controls WebView	Log
1390638	dotnet/maui	Controls WebView	Log	dotnet/maui#35064
1390755	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127258
1390731	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127267
1390765	dotnet/runtime	Send tests to Helix (Unix)	Log
1390611	dotnet/maui	Controls CollectionView	Log	dotnet/maui#35011
1390623	dotnet/maui	Controls Layout	Log	dotnet/maui#34997
1390727	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127264
1390620	dotnet/maui	Controls WebView	Log	dotnet/maui#33312
1390617	dotnet/maui	Controls CollectionView	Log	dotnet/maui#32674
1390613	dotnet/maui	Controls WebView	Log	dotnet/maui#34699
2957284	dotnet-maui	Controls (vlatest) Navigation	Log
2957292	dotnet-maui	Controls (vlatest) Editor,Effects,Essentials,FlyoutPage,Focus,Fonts,Frame,Gestures,GraphicsView	Log
1390688	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127266
1390662	dotnet/runtime	Publish Build Assets	Log	dotnet/runtime#126838
1390695	dotnet/runtime	Send to Helix	Log
1390683	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127263
1390671	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127262
2957380	dotnet-runtime	Install workload using artifacts	Log
1390536	dotnet/maui	Controls WebView	Log
1390531	dotnet/maui	Controls Shell	Log
1390619	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127229
1390570	dotnet/runtime	Send tests to Helix (Unix)	Log
1390579	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127213
1390571	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#125559
1390558	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#123969
1390010	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127241
1390561	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#126782
2957291	dotnet-maui	Install dotnet preview without workloads	Log
2957283	dotnet-maui	Provision Android SDK - Platform APIs	Log
1390552	dotnet/runtime	Send to Helix	Log	dotnet/runtime#126947
1390252	dotnet/runtime	Send to Helix	Log	dotnet/runtime#126259
1390326	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127182
1390541	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127210
1390549	dotnet/aspnetcore	Run Quarantined Tests	Log	dotnet/aspnetcore#66409
2957307	dotnet-docker-tools	🟪 Clean public/dotnet/* (pruneEol > 15d)	Log
1390523	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127258
1390519	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127135
1390417	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#127254
1390493	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127248
1390399	dotnet/runtime	Send to Helix	Log
1390442	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127192
1390433	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127178
1390421	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#126916
1390445	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#127192
1389986	dotnet/runtime	Send tests to Helix (Unix)	Log
1390414	dotnet/runtime	Send to Helix	Log	dotnet/runtime#122056
1390409	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#125180
1390420	dotnet/runtime	Send tests to Helix (Unix)	Log
1390402	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127254
1390392	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127229
1389908	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127200
1389949	dotnet/runtime	Send to Helix	Log	dotnet/runtime#126972
1390344	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127181
1390330	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127252
1390362	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127253
1390315	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#126904
1390311	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127246
1390268	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#126279
1390256	dotnet/runtime	Send to Helix (Unix)	Log	dotnet/runtime#127074
1390272	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127251
1390247	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127199
2957158	dotnet-runtime	Send job to Helix (Unix)	Log
1390015	dotnet/maui	Controls WebView	Log	dotnet/maui#35061
1389981	dotnet/maui	Controls WebView	Log
Displaying 100 of 2928 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
156	731	2928

[dkurepa]

These appear to be timeout cancellations, and most of them are happening on the same runtime leg that uses OSX.1200.ARM64.Open, looking at grafana, they do indeed appear to be quite high. Will check with the team on what we can do about this

[dkurepa]

For pipelines experiencing timeouts on osx.1200.arm64.open we recommend using osx.14.arm64.open, as this queue has a lot more machines

[dkurepa]

There is also a number of Publish Using Darc timeouts, these are in 99% of cases AzDo Api issues. During the Publish Using Darc job, we queue up a Maestro Promotion pipeline, that downloads the artifacts from the build calling it, and publishes them where they need to go. While publishing is happening, the build pipeline keeps busy waiting for the promotion pipeline to be done, checking the status of it every 60 seconds. In cases where this times out, the build most likely did get promoted, the AzDo API just kept telling us the wrong thing

[ivanpovazan]

@dkurepa for context, the same timeouts are also caught with this tracking #1883
where I asked about potentially bumping the queues to osx.13.amd/arm64, would that suffice?
(bumping to osx.14 is not an option right now as we still want testing on osx.13 which is the minimum supported OS version)

[CarnaViire]

For the "known issues" folks: the timeout here is reported twice, making BA red despite the tracking issue. E.g.:

1️⃣ dotnet/runtime#117255

2️⃣ dotnet/runtime#117800

cc @AlitzelMendez