dotnet
Tracking issue for AzDO IcM: "AzureDevOps: Tests results search for a build are non deterministic"
https://portal.microsofticm.com/imp/v3/incidents/details/301407309/home
This issue is that when searching test results in a build, the search results returns partial results... and more results each time you search (search and get one, search a minute later, and now there are seven).
It causes customers not to be able to tell what tests are actually running, which makes bring up new platforms/features difficult, since it's possible to miss coverage in the complex matrix.
This was reported by a customer in an email thread when we were discussing their usage patterns. (They are relying on other services they are maintaining to solve this basic bug in AzDO)
Feature request - https://dev.azure.com/mseng/AzureDevOps/_workitems/edit/1943353 has been submit. We are currently waiting for AzDo to complete this work.
AzDO team made some changes to the UI, so I followed up with customers who had reported the issue to us originally. Even though the results load in chunks, upon filtering/searching, the issue still remains where it does not return all the results expected. Followed up with the AzDO team regarding this functionality still not working. (Conversation in private Team channel)
Following up: AzDO had a conversation with one of our product team customers and came to an agreement of how to further improve the searching, especially when there are millions of test results.
Checked in on the state of the feature on AzDO's side and they said they resolved it in August. Closing this.