8000 DotnetCliSnapshotTests.VerifyCompletions failed in CI · Issue #48817 · dotnet/sdk · GitHub
[go: up one dir, main page]
Skip to content

DotnetCliSnapshotTests.VerifyCompletions failed in CI #48817

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for 8000 GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
tmat opened this issue May 5, 2025 · 2 comments
Open

DotnetCliSnapshotTests.VerifyCompletions failed in CI #48817

tmat opened this issue May 5, 2025 · 2 comments
Labels
Area-CLI untriaged Request triage from a team member

Comments

@tmat
Copy link
Member
tmat commented May 5, 2025 •
edited
Loading

Intermittent failure:

https://dev.azure.com/dnceng-public/public/_build/results?buildId=1032392&view=ms.vss-test-web.build-test-results-tab&runId=27730070&resultId=104318&paneView=debug

log:

 Microsoft.DotNet.Cli.Completions.Tests.DotnetCliSnapshotTests.VerifyCompletions(shellName: "zsh") [FAIL]
[xUnit.net 00:02:12.31]       VerifyException : Directory: C:\h\w\A14108D1\w\B59309C8\e\snapshots\zsh
NotEqual:
  - Received: DotnetCliSnapshotTests.VerifyCompletions.received.zsh
    Verified: DotnetCliSnapshotTests.VerifyCompletions.verified.zsh

FileContent:

NotEqual:

Received: DotnetCliSnapshotTests.VerifyCompletions.received.zsh
Verified: DotnetCliSnapshotTests.VerifyCompletions.verified.zsh
Compare Result:
0836                         '-r=[]:RUNTIME_IDENTIFIER:->dotnet_dynamic_complete' \
[xUnit.net 00:02:12.31]          -                         '--project=[The path to the project file to run (defaults to the current directory if there is only one project).]: : ' \
[xUnit.net 00:02:12.31]          -                         '--launch-profile=[The name of the launch profile (if any) to use when launching the application.]: : ' \
[xUnit.net 00:02:12.31]          -                         '-lp=[The name of the launch profile (if any) to use when launching the application.]: : ' \
[xUnit.net 00:02:12.31]          +                         '--project=[The path to the project file to run (defaults to the current directory if there is only one project).]:project: ' \
[xUnit.net 00:02:12.31]          +                         '--launch-profile=[The name of the launch profile (if any) to use when launching the application.]:launch-profile: ' \
[xUnit.net 00:02:12.31]          +                         '-lp=[The name of the launch profile (if any) to use when launching the application.]:launch-profile: ' \
[xUnit.net 00:02:12.31]       0840                         '--no-launch-profile[Do not attempt to use launchSettings.json to configure the application.]' \


[xUnit.net 00:02:12.31]       Output:
[xUnit.net 00:02:12.31]         CI environment detected, using snapshots directory in the current working directory C:\h\w\A14108D1\w\B59309C8\e
[xUnit.net 00:02:12.31]     Microsoft.DotNet.Cli.Completions.Tests.DotnetCliSnapshotTests.VerifyCompletions(shellName: "nushell") [OUTPUT] CI environment detected, using snapshots directory in the current working directory C:\h\w\A14108D1\w\B59309C8\e
[xUnit.net 00:02:12.31]     Microsoft.DotNet.Cli.Completions.Tests.DotnetCliSnapshotTests.VerifyCompletions(shellName: "nushell") [PASS]
[xUnit.net 00:02:12.31]       Output:
[xUnit.net 00:02:12.31]         CI environment detected, using snapshots directory in the current working directory C:\h\w\A14108D1\w\B59309C8\e
Running C:\Program Files\Microsoft Visual Studio\2022\Preview\MSBuild\Current\Bin\msbuild.exe /t:Restore C:\h\w\A14108D1\t\dotnetSdkTests\zozkik0h.q4t\ItRunsABackwa---7EB748CC\11TestAppWith10CLIToolReferences.csproj
[xUnit.net 00:02:12.32]     Microsoft.DotNet.Cli.Build.Tests.GivenThatWeWantToBeBackwardsCompatibleWith1xProjects.ItRunsABackwardsVersionedTool [OUTPUT] Executing 'dotnet /t:Restore C:\h\w\A14108D1\t\dotnetSdkTests\zozkik0h.q4t\ItRunsABackwa---7EB748CC\11TestAppWith10CLIToolReferences.csproj':
> C:\Program Files\Microsoft Visual Studio\2022\Preview\MSBuild\Current\Bin\msbuild.exe /t:Restore C:\h\w\A14108D1\t\dotnetSdkTests\zozkik0h.q4t\ItRunsABackwa---7EB748CC\11TestAppWith10CLIToolReferences.csproj
Process ID: 8108
[xUnit.net 00:02:12.47]     Microsoft.DotNet.Cli.Build.Tests.GivenThatWeWantToBeBackwardsCompatibleWith1xProjects.ItRunsABackwardsVersionedTool [OUTPUT] 》MSBuild version 17.14.0-preview-25127-07+c012996cf for .NET Framework
[xUnit.net 00:02:12.81]     Microsoft.DotNet.Cli.Build.Tests.GivenThatWeWantToBeBackwardsCompatibleWith1xProjects.ItRunsABackwardsVersionedTool [OUTPUT] 》Build started 5/2/2025 6:34:34 PM.
[xUnit.net 00:02:12.82]     Microsoft.DotNet.Cli.Build.Tests.GivenThatWeWantToBeBackwardsCompatibleWith1xProjects.ItRunsABackwardsVersionedTool [OUTPUT] 》
@dotnet-policy-service dotnet-policy-service bot added the untriaged Request triage from a team member label May 5, 2025
@Forgind
Copy link
Contributor
Forgind commented May 5, 2025

I saw this in one of my PRs, too, and did this:
105a59f

That problem went away, though there seems to be another unhappy test.

@Forgind Forgind mentioned this issue May 14, 2025
Open
@edvilme
Copy link
Contributor
edvilme commented May 20, 2025

These need to be updated when running changing the strings on the CLI.
First run the VerifyCompletions tests, then run the targets /t:CompareCliSnapshots and /t:UpdateCliSnapshots (see #48396)
This should update the CLI completions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Area-CLI untriaged Request triage from a team member
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@tmat @edvilme @Forgind
0