E540 Adding an e2e test on Windows GMSA support by wk8 · Pull Request #74738 · kubernetes/kubernetes · GitHub
[go: up one dir, main page]

Skip to content

Conversation

wk8
Copy link
Contributor
@wk8 wk8 commented Feb 28, 2019

What type of PR is this?
/kind feature

What this PR does / why we need it:

This patch is adding an e2e on the Windows GMSA support added in
#73726 and
#74737.

Which issue(s) this PR fixes:
@yujuhong requested an e2e test on this at #73726 (review).

Special notes for your reviewer:
This e2e test has been verified to pass on a cluster with a Windows node with the
WindowsGMSA=true feature gate enabled (and the kubelet compiled from
#74737); however, I don't believe that
feature gate is enabled when running a "regular" build. Would it be possible to:

  1. enable that feature gate when running Windows e2e tests in a build?
  2. or else enable dynamic Kubelet config for these tests, so that each spec can
    set the config it needs?

Does this PR introduce a user-facing change?:

NONE

@k8s-ci-robot k8s-ci-robot added release-note-none Denotes a PR that doesn't merit a release note. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. needs-kind Indicates a PR lacks a `kind/foo` label and requires one. needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. needs-priority Indicates a PR lacks a `priority/foo` label and requires one. labels Feb 28, 2019
@k8s-ci-robot
Copy link
Contributor

Hi @wk8. Thanks for your PR.

I'm waiting for a kubernetes member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@k8s-ci-robot k8s-ci-robot added the needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. label Feb 28, 2019
@wk8
Copy link
Contributor Author
wk8 commented Feb 28, 2019

@yujuhong @dchen1107 @michmike @PatrickLang : guidance appreciated as to how to make sure that e2e test can run successfully as part of builds (see the Special notes for your reviewer section in the PR message). Thanks!

@k8s-ci-robot k8s-ci-robot added sig/testing Categorizes an issue or PR as relevant to SIG Testing. and removed needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. labels Feb 28, 2019
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ddebroy
Copy link
Contributor
ddebroy commented Feb 28, 2019

/ok-to-test

@k8s-ci-robot k8s-ci-robot added ok-to-test Indicates a non-member PR verified by an org member that is safe to test. and removed needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. labels Feb 28, 2019
@ddebroy
Copy link
Contributor
ddebroy commented Feb 28, 2019

/assign dchen1107

@ddebroy
Copy link
Contributor
ddebroy commented Feb 28, 2019

/assign @adelina-t @BCLAU

@ddebroy
Copy link
Contributor
ddebroy commented Feb 28, 2019

/sig windows

@k8s-ci-robot k8s-ci-robot added the sig/windows Categorizes an issue or PR as relevant to SIG Windows. label Feb 28, 2019
Copy link
Member
@neolit123 neolit123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/area test
/kind feature
/priority important-soon

@k8s-ci-robot k8s-ci-robot added area/test kind/feature Categorizes issue or PR as related to a new feature. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. labels Feb 28, 2019
@michmike
Copy link
Contributor
michmike commented Mar 2, 2019

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Mar 2, 2019
@michmike
Copy link
Contributor
michmike commented Mar 2, 2019

/assign @dchen1107

Copy link
Contributor
@adelina-t adelina-t left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for this PR :). Left some comments inside.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not a fan of this being hardcoded here.

Also, the pause image here ( the one returned by GetPauseImageName() ):

Pause = Config{gcRegistry, "pause", "3.1"}
can be a windows image.

By passing this env var:

repoList := os.Getenv("KUBE_TEST_REPO_LIST")

with a file containing the registry names for windows images, the pause image should be fine.

In the upstream tests we use these registries: https://github.com/kubernetes-sigs/windows-testing/blob/master/images/image-repo-list

In fact, all the dockerfiles + documentation of the images we use in upstream e2e windows tests is here:

https://github.com/kubernetes-sigs/windows-testing

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same comment as above. No need to hardcore. We should just use one of the images in "k8s.io/kubernetes/test/utils/image", they are all based on windowsservercore , thus will have powershell. If not, we can just define another image in "k8s.io/kubernetes/test/utils/image", either way I suggest we stick to having all image names and repos there.

@k8s-ci-robot k8s-ci-robot removed the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Mar 5, 2019
@wk8
Copy link
Contributor Author
wk8 commented Mar 6, 2019

Thanks for the review @adelina-t :) addressed your comments.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Considering that kubernetes-sigs/windows-testing is the official repo, that would make it's image-repo-list file official and up to date. I would just have that file mentioned, no need for both.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well, the command and args are unnecessary. It is a pause image after all, it is supposed to do that anyways.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch, thanks. Changed.

Sorry I forgot changing this as part of 9eac1bebd024ccf510ab126c08d7dfacd1e651d0 (was using image mcr.microsoft.com/powershell before).

@k8s-ci-robot k8s-ci-robot added needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. and removed needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. labels Mar 6, 2019
@ddebroy
Copy link
Contributor
ddebroy commented Mar 6, 2019

/test pull-kubernetes-e2e-gce

Copy link
Contributor
@ddebroy ddebroy Mar 6, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can this be moved to a separate commit from the main GMSA test commit? Ok to be part of the same PR.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Copy link
Contributor
@ddebroy ddebroy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good overall. Please address the FIX comment, squash the commits and separate out the README fix to a separate commit.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This needs to be removed/fixed right?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes - but before I remove it I'd like to see it failing where it's supposed to be running, to make sure this test actually runs somewhere... And I haven't seen that yet?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Discussed with @wk8 offline that these tests won't run as PROW or get picked up by the other testgrid suites right now.

wk8 added 2 commits March 6, 2019 17:58
Signed-off-by: Jean Rouge <rougej+github@gmail.com>
This patch is adding an e2e on the Windows GMSA support added in
kubernetes#73726 and
kubernetes#74737.

Signed-off-by: Jean Rouge <rougej+github@gmail.com>
@ddebroy
Copy link
Contributor
ddebroy commented Mar 7, 2019

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Mar 7, 2019
@ddebroy
Copy link
Contributor
ddebroy commented Mar 7, 2019

/test pull-kubernetes-e2e-gce-100-performance

@michmike
Copy link
Contributor
michmike commented Mar 7, 2019

/approve

@michmike
Copy link
Contributor
michmike commented Mar 7, 2019

/lgtm

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: michmike, wk8

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Mar 7, 2019
@k8s-ci-robot k8s-ci-robot merged commit 96ee0d0 into kubernetes:master Mar 7, 2019
@@ -0,0 +1,155 @@
/*
Copyright 2018 The Kubernetes Authors.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

s/2018/2019

f.PodClient().Create(pod)

ginkgo.By("waiting for the pod and its containers to be running")
gomega.Eventually(func() bool {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can just use framework.WaitForPodReady()
There are other utilities functions like that. Is there any reason to roll your own?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No reason other than I didn't spot these functions, apologies. @adelina-t kindly fixed that in #75116

4B9A
@liggitt liggitt added this to the v1.14 milestone Jun 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/test cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. kind/feature Categorizes issue or PR as related to a new feature. lgtm "Looks good to me", indicates that a PR is ready to be merged. ok-to-test Indicates a non-member PR verified by an org member that is safe to test. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. release-note-none Denotes a PR that doesn't merit a release note. sig/testing Categorizes an issue or PR as relevant to SIG Testing. sig/windows Categorizes an issue or PR as relevant to SIG Windows. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

10 participants
0