8000 Re-balance CI tests by iSazonov · Pull Request #11420 · PowerShell/PowerShell · GitHub
[go: up one dir, main page]

Skip to content

Conversation

@iSazonov
Copy link
Collaborator
@iSazonov iSazonov commented Dec 21, 2019

PR Summary

Re-balance tests to reduce CI times for PRs.

Better review commit by commit.

PR Context

PR Checklist

@iSazonov iSazonov self-assigned this Dec 21, 2019
@iSazonov iSazonov force-pushed the test-improve-perf branch from ecce392 to 1e806eb Compare 10BC0 December 21, 2019 18:48
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@iSazonov, your last commit had 1 failures in PowerShell-CI-windows
Tests for Get-ComputerInfo: Ensure Type returned.Verify type returned by Get-ComputerInfo

Expected the value to have type [Microsoft.PowerShell.Commands.ComputerInfo] or any of its subtypes, but got @{BiosCaption=Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz} with type [PSCustomObject].
at <ScriptBlock>, D:\a\1\s\test\powershell\Modules\Microsoft.PowerShell.Management\Get-ComputerInfo.Tests.ps1: line 1011
1011:             $computerInfo | Should -BeOfType 'Microsoft.PowerShell.Commands.ComputerInfo'

@iSazonov iSazonov force-pushed the test-improve-perf branch 3 times, most recently from db545b7 to 1868802 Compare December 22, 2019 11:18
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@iSazonov, your last commit had 1 failures in PowerShell-CI-windows
Basic FileSystem Provider Tests.Appx path.Can get an appx package item

Cannot find path 'TestDrive:\Calculator.exe' because it does not exist.
at <ScriptBlock>, D:\a\1\s\test\powershell\Modules\Microsoft.PowerShell.Management\FileSystem.Tests.ps1: line 292
292:             Get-Item $pkgDir\Calculator.exe -ErrorAction Stop | Should -BeOfType [System.IO.FileInfo]

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@iSazonov, your last commit had 1 failures in PowerShell-CI-linux
Test-Connection.TraceRoute.returns false without error if MaxHops is exceeded during -Traceroute -Quiet

Missing an argument for parameter 'TimeoutSeconds'. Specify a parameter of type 'System.Int32' and try again.
at <ScriptBlock>, /home/vsts/work/1/s/test/powershell/Modules/Microsoft.PowerShell.Management/Test-Connection.Tests.ps1: line 278
278:             Test-Connection 8.8.8.8 -Traceroute -MaxHops 2 -TimeoutSeconds -Quiet | Should -BeFalse

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@iSazonov, your last commit had 2 failures in PowerShell-CI-windows
Basic FileSystem Provider Tests.Appx path.Can get an appx package item

Cannot find path 'TestDrive:\Calculator.exe' because it does not exist.
at <ScriptBlock>, D:\a\1\s\test\powershell\Modules\Microsoft.PowerShell.Management\FileSystem.Tests.ps1: line 292
292:             Get-Item $pkgDir\Calculator.exe -ErrorAction Stop | Should -BeOfType [System.IO.FileInfo]

Test-Connection.TraceRoute.returns false without error if MaxHops is exceeded during -Traceroute -Quiet

Missing an argument for parameter 'TimeoutSeconds'. Specify a parameter of type 'System.Int32' and try again.
at <ScriptBlock>, D:\a\1\s\test\powershell\Modules\Microsoft.PowerShell.Management\Test-Connection.Tests.ps1: line 278
278:             Test-Connection 8.8.8.8 -Traceroute -MaxHops 2 -TimeoutSeconds -Quiet | Should -BeFalse

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@iSazonov, your last commit had 1 failures in PowerShell-CI-macos
Test-Connection.TraceRoute.returns false without error if MaxHops is exceeded during -Traceroute -Quiet

Missing an argument for parameter 'TimeoutSeconds'. Specify a parameter of type 'System.Int32' and try again.
at <ScriptBlock>, /Users/runner/runners/2.163.1/work/1/s/test/powershell/Modules/Microsoft.PowerShell.Management/Test-Connection.Tests.ps1: line 278
278:             Test-Connection 8.8.8.8 -Traceroute -MaxHops 2 -TimeoutSeconds -Quiet | Should -BeFalse

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@iSazonov, your last commit had 2 failures in PowerShell-CI-windows
Basic FileSystem Provider Tests.Appx path.Can get an appx package item

Cannot find path 'TestDrive:\Calculator.exe' because it does not exist.
at <ScriptBlock>, D:\a\1\s\test\powershell\Modules\Microsoft.PowerShell.Management\FileSystem.Tests.ps1: line 292
292:             Get-Item $pkgDir\Calculator.exe -ErrorAction Stop | Should -BeOfType [System.IO.FileInfo]

Test-Connection.TraceRoute.returns false without error if MaxHops is exceeded during -Traceroute -Quiet

Missing an argument for parameter 'TimeoutSeconds'. Specify a parameter of type 'System.Int32' and try again.
at <ScriptBlock>, D:\a\1\s\test\powershell\Modules\Microsoft.PowerShell.Management\Test-Connection.Tests.ps1: line 278
278:             Test-Connection 8.8.8.8 -Traceroute -MaxHops 2 -TimeoutSeconds -Quiet | Should -BeFalse

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@iSazonov, your last commit had 1 failures in PowerShell-CI-linux
Test-Connection.TraceRoute.returns false without error if MaxHops is exceeded during -Traceroute -Quiet

Missing an argument for parameter 'TimeoutSeconds'. Specify a parameter of type 'System.Int32' and try again.
at <ScriptBlock>, /home/vsts/work/1/s/test/powershell/Modules/Microsoft.PowerShell.Management/Test-Connection.Tests.ps1: line 278
278:             Test-Connection 8.8.8.8 -Traceroute -MaxHops 2 -TimeoutSeconds -Quiet | Should -BeFalse

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@iSazonov, your last commit had 1 failures in PowerShell-CI-macos
Test-Connection.TraceRoute.returns false without error if MaxHops is exceeded during -Traceroute -Quiet

Missing an argument for parameter 'TimeoutSeconds'. Specify a parameter of type 'System.Int32' and try again.
at <ScriptBlock>, /Users/runner/runners/2.163.1/work/1/s/test/powershell/Modules/Microsoft.PowerShell.Management/Test-Connection.Tests.ps1: line 278
278:             Test-Connection 8.8.8.8 -Traceroute -MaxHops 2 -TimeoutSeconds -Quiet | Should -BeFalse

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@iSazonov, your last commit had 1 failures in PowerShell-CI-windows
Enter-PSHostProcess tests.By CustomPipeName.Can enter, exit, and re-enter using CustomPipeName

Expected $true, because The script was able to re-enter another process and grab the pipe of '4pzbeujh.2it'., but got $false.
at <ScriptBlock>, D:\a\1\s\test\powershell\Modules\Microsoft.PowerShell.Core\Enter-PSHostProcess.Tests.ps1: line 186
186:                     Should -BeTrue -Because "The script was able to re-enter another process and grab the pipe of '$pipeName'."

@iSazonov
Copy link
Collaborator Author

@SteveL-MSFT @vexx32 I reverted last commit because it cause the test fail #11420 (review) that looks very amizing.
I can not repo locally (I don't see 40 sec delay).
I concern this could be a tricky bug in our code.

@iSazonov iSazonov marked this pull request as ready for review December 30, 2019 10:50
@iSazonov iSazonov added the CL-Test Indicates that a PR should be marked as a test change in the Change Log label Dec 30, 2019
@iSazonov iSazonov added this to the 7.1.0-preview.1 milestone Dec 30, 2019
@iSazonov iSazonov changed the title Improve test performance Re-balance CI tests Dec 30, 2019
@TravisEz13
Copy link
Member

Can we split this into two PRs? One for the tests fixes and refactoring and one for the rebalancing?

@iSazonov
Copy link
Collaborator Author
iSazonov commented Jan 4, 2020

Can we split this into two PRs? One for the tests fixes and refactoring and one for the rebalancing?

@TravisEz13 There are only two commits/files for explicit rebalancing where I replace CI tag with Feature one - Jobs and HelpSystemOnline. I don't see any value to move them to new PR. I guess you ask about first commit "Correct pwsh run" that single looks like unrelated change.
Moved to #11486

@iSazonov iSazonov mentioned this pull request Jan 4, 2020
14 tasks
@iSazonov iSazonov merged commit 99cf9fd into PowerShell:master Jan 5, 2020
@iSazonov iSazonov deleted the test-improve-perf branch January 5, 2020 08:01
@iSazonov iSazonov restored the test-improve-perf branch January 8, 2020 15:23
@ghost
Copy link
ghost commented Mar 26, 2020

🎉v7.1.0-preview.1 has been released which incorporates this pull request.:tada:

Handy links:

@iSazonov iSazonov deleted the test-improve-perf branch May 15, 2020 13:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CL-Test Indicates that a PR should be marked as a test change in the Change Log

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

0