Skip to content

CI: add kvm-docker-linux-x86-64 integration test in prow#21556

Merged
medyagh merged 4 commits intokubernetes:masterfrom
ComradeProgrammer:kvm_prow
Nov 8, 2025
Merged

CI: add kvm-docker-linux-x86-64 integration test in prow#21556
medyagh merged 4 commits intokubernetes:masterfrom
ComradeProgrammer:kvm_prow

Conversation

@ComradeProgrammer
Copy link
Copy Markdown
Member

@ComradeProgrammer ComradeProgrammer commented Sep 14, 2025 •
edited
Loading

  1. implement a new binary minitest to allocate a new test environment(gcp project) via boskos in prow
  2. migrate old KVM_Linux integration test into prow

closes #21332

@k8s-ci-robot k8s-ci-robot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Sep 14, 2025
@k8s-ci-robot k8s-ci-robot requested a review from nirs September 14, 2025 23:23
@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. approved Indicates a PR has been approved by an approver from all required OWNERS files. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Sep 14, 2025
@ComradeProgrammer ComradeProgrammer force-pushed the kvm_prow branch 3 times, most recently from c19610d to a232d5e Compare September 14, 2025 23:37
medyagh
medyagh reviewed Sep 22, 2025
View reviewed changes
medyagh
medyagh reviewed Sep 22, 2025
View reviewed changes
@k8s-ci-robot k8s-ci-robot added size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. and removed size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Sep 27, 2025
@ComradeProgrammer ComradeProgrammer force-pushed the kvm_prow branch 7 times, most recently from 6543f9a to a0e55b8 Compare September 28, 2025 22:21
@ComradeProgrammer ComradeProgrammer force-pushed the kvm_prow branch 3 times, most recently from 6f29cd6 to a961e63 Compare October 11, 2025 19:28
@ComradeProgrammer ComradeProgrammer changed the title [WIP][CI] add minikubekvm integration test in prow [CI] add minikubekvm integration test in prow Oct 11, 2025
@k8s-ci-robot k8s-ci-robot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Oct 11, 2025
@linux-foundation-easycla
Copy link
Copy Markdown

linux-foundation-easycla bot commented Oct 12, 2025 •
edited
Loading

CLA Signed

The committers listed above are authorized under a signed CLA.

@k8s-ci-robot k8s-ci-robot added cncf-cla: no Indicates the PR's author has not signed the CNCF CLA. and removed cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. labels Oct 12, 2025
@ComradeProgrammer ComradeProgrammer changed the title [CI] add minikubekvm integration test in prow [CI] add kvm-docker-linux-x86-64 integration test in prow Oct 26, 2025
medyagh
medyagh requested changes Oct 27, 2025
View reviewed changes
@medyagh
Copy link
Copy Markdown
Member

medyagh commented Oct 30, 2025

/ok-to-test

@k8s-ci-robot k8s-ci-robot added the ok-to-test Indicates a non-member PR verified by an org member that is safe to test. label Oct 30, 2025
medyagh
medyagh requested changes Oct 30, 2025
View reviewed changes
medyagh
medyagh reviewed Nov 3, 2025
View reviewed changes
@medyagh medyagh changed the title [CI] add kvm-docker-linux-x86-64 integration test in prow CI: add kvm-docker-linux-x86-64 integration test in prow Nov 7, 2025
@medyagh
Copy link
Copy Markdown
Member

medyagh commented Nov 7, 2025

thank you @ComradeProgrammer great work in getting this to the finish line

@medyagh
Copy link
Copy Markdown
Member

medyagh commented Nov 7, 2025

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Nov 7, 2025
@medyagh
Copy link
Copy Markdown
Member

medyagh commented Nov 7, 2025

@ComradeProgrammer jenkins cross build failing


:48:22 GitHub pull request #21556 of commit 55b3035fd89fbd57ee0b91c46039eb81f1287ceb, no merge conflicts.
13:48:22 Running as SYSTEM
13:48:23 Setting status of 55b3035fd89fbd57ee0b91c46039eb81f1287ceb to PENDING with url https://storage.googleapis.com/minikube-builds/logs/21556/index.html and message: 'Build started for merge commit.'
13:48:23 Using context: Jenkins Cross Build
13:48:23 [EnvInject] - Loading node environment variables.
13:48:23 [EnvInject] - Preparing an environment for the build.
13:48:23 [EnvInject] - Keeping Jenkins system variables.
13:48:23 [EnvInject] - Keeping Jenkins build variables.
13:48:24 [EnvInject] - Evaluating the Groovy script content
13:48:24 [EnvInject] - Injecting contributions.
13:48:25 Building remotely on [Ubuntu Agent 10](https://minikube-jenkins.corp.goog/computer/Ubuntu%20Agent%2010/) (kvm kic-docker docker) in workspace /home/jenkins/workspace/Build_Cross
13:48:25 [WS-CLEANUP] Deleting project workspace...
13:48:25 [WS-CLEANUP] Deferred wipeout is used...
13:48:26 The recommended git tool is: NONE
13:48:59 using credential Minikube Bot
13:48:59 Cloning the remote Git repository
13:49:00 Cloning repository https://github.com/kubernetes/minikube.git
13:49:00  > git init /home/jenkins/workspace/Build_Cross # timeout=10
13:49:01 Fetching upstream changes from https://github.com/kubernetes/minikube.git
13:49:01  > git --version # timeout=10
13:49:01  > git --version # 'git version 2.34.1'
13:49:01 using GIT_ASKPASS to set credentials 
13:49:01  > git fetch --tags --force --progress -- https://github.com/kubernetes/minikube.git +refs/heads/*:refs/remotes/origin/* # timeout=10
13:49:11  > git config remote.origin.url https://github.com/kubernetes/minikube.git # timeout=10
13:49:11  > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
13:49:19  > git config remote.origin.url https://github.com/kubernetes/minikube.git # timeout=10
13:49:19 Fetching upstream changes from https://github.com/kubernetes/minikube.git
13:49:19 using GIT_ASKPASS to set credentials 
13:49:19  > git fetch --tags --force --progress -- https://github.com/kubernetes/minikube.git +refs/pull/*:refs/remotes/origin/pr/* # timeout=10
13:49:41  > git rev-parse refs/remotes/origin/pr/21556/merge^{commit} # timeout=10
13:49:41 JENKINS-19022: warning: possible memory leak due to Git plugin usage; see: https://plugins.jenkins.io/git/#remove-git-plugin-buildsbybranch-builddata-script
13:49:41 Checking out Revision 22a75abcad8af84f8217c5229473d3cf308d1656 (refs/remotes/origin/pr/21556/merge)
13:49:41  > git config core.sparsecheckout # timeout=10
13:49:41  > git checkout -f 22a75abcad8af84f8217c5229473d3cf308d1656 # timeout=10
13:49:47 Commit message: "Merge 55b3035fd89fbd57ee0b91c46039eb81f1287ceb into 438e647083fa3d88b20ef0edf773bdab0b9bb9d1"
13:49:47 First time build. Skipping changelog.
13:49:47 Run condition [Environment variable exists] enabling prebuild for step [Inject environment variables]
13:49:47 [EnvInject] - Injecting environment variables from a build step.
13:49:47 [EnvInject] - Injecting as environment variables the properties content 
13:49:47 THE_COMMIT=$GIT_COMMIT
13:49:47 
13:49:47 [EnvInject] - Variables injected successfully.
13:49:47 Variable Existence Condition: checking "sha1" variable 
13:49:47 Run condition [Environment variable exists] enabling perform for step [Inject environment variables]
13:49:47 [EnvInject] - Injecting environment variables from a build step.
13:49:47 [EnvInject] - Injecting as environment variables the properties content 
13:49:47 THE_COMMIT=55b3035fd89fbd57ee0b91c46039eb81f1287ceb
13:49:47 
13:49:47 [EnvInject] - Variables injected successfully.
13:49:48 [Build_Cross] $ /bin/bash -xe /tmp/jenkins15975974220979532329.sh
13:49:48 + set -e
13:49:48 + env
13:49:48 SHELL=/bin/bash
13:49:48 ghprbPullAuthorLogin=ComradeProgrammer
13:49:48 access_token=****
13:49:48 GOPOGH_DB_BACKEND=postgres
13:49:48 RUN_TESTS_DISPLAY_URL=https://minikube-jenkins.corp.goog/job/Build_Cross/42239/display/redirect?page=tests
13:49:48 JENKINS_SERVER_COOKIE=fd8a7b33dde6712f
13:49:48 BUILD_CAUSE=GHPRBCAUSE
13:49:48 RUN_CHANGES_DISPLAY_URL=https://minikube-jenkins.corp.goog/job/Build_Cross/42239/display/redirect?page=changes
13:49:48 GOBIN=/home/jenkins/go/bin
13:49:48 GOPOGH_DB_HOST=k8s-minikube:us-west1:flake-rate
13:49:48 PWD=/home/jenkins/workspace/Build_Cross
13:49:48 HUDSON_HOME=/mnt/disks/sdb/jenkins
13:49:48 LOGNAME=jenkins
13:49:48 XDG_SESSION_TYPE=tty
13:49:48 BUILD_URL=https://minikube-jenkins.corp.goog/job/Build_Cross/42239/
13:49:48 JOB_URL=https://minikube-jenkins.corp.goog/job/Build_Cross/
13:49:48 BUILD_NUMBER=42239
13:49:48 ghprbPullAuthorLoginMention=@ComradeProgrammer
13:49:48 ghprbPullLink=https://github.com/kubernetes/minikube/pull/21556
13:49:48 THE_COMMIT=55b3035fd89fbd57ee0b91c46039eb81f1287ceb
13:49:48 MOTD_SHOWN=pam
13:49:48 BUILD_DISPLAY_NAME=#42239
13:49:48 HOME=/home/jenkins
13:49:48 LANG=C.UTF-8
13:49:48 GOPOGH_DB_PATH=user=528047478195-compute@developer database=flaketest2
13:49:48 ghprbPullDescription=GitHub pull request #21556 of commit 55b3035fd89fbd57ee0b91c46039eb81f1287ceb, no merge conflicts.
13:49:48 JENKINS_URL=https://minikube-jenkins.corp.goog/
13:49:48 JOB_BASE_NAME=Build_Cross
13:49:48 sha1=origin/pr/21556/merge
13:49:48 ghprbPullTitle=[CI] add kvm-docker-linux-x86-64 integration test in prow
13:49:48 JOB_NAME=Build_Cross
13:49:48 RUN_DISPLAY_URL=https://minikube-jenkins.corp.goog/job/Build_Cross/42239/display/redirect
13:49:48 ghprbTargetBranch=master
13:49:48 SSH_CONNECTION=10.128.0.2 51582 10.164.0.2 22
13:49:48 JOB_DISPLAY_URL=https://minikube-jenkins.corp.goog/job/Build_Cross/display/redirect
13:49:48 ghprbActualCommit=55b3035fd89fbd57ee0b91c46039eb81f1287ceb
13:49:48 ghprbCommentBody=null
13:49:48 WORKSPACE=/home/jenkins/workspace/Build_Cross
13:49:48 DOCKERHUB_READONLY_TOKEN=****
13:49:48 ghprbPullLongDescription=1. implement a new binary `minitest` to allocate a new test environment(gcp project) via boskos in prow\r\n2. migrate old KVM_Linux integration test into prow\r\n\r\n\r\ncloses https://github.com/kubernetes/minikube/issues/21332
13:49:48 ghprbActualCommitAuthorEmail=tangjiaming1999@gmail.com
13:49:48 HUDSON_URL=https://minikube-jenkins.corp.goog/
13:49:48 XDG_SESSION_CLASS=user
13:49:48 ghprbCredentialsId=Github Access Token
13:49:48 NODE_NAME=Ubuntu Agent 10
13:49:48 BRANCH=origin/pr/21556/merge
13:49:48 USER=jenkins
13:49:48 HUDSON_SERVER_COOKIE=fd8a7b33dde6712f
13:49:48 GIT_URL=https://github.com/kubernetes/minikube.git
13:49:48 SHLVL=1
13:49:48 BUILD_TAG=jenkins-Build_Cross-42239
13:49:48 EXECUTOR_NUMBER=0
13:49:48 HUDSON_COOKIE=1877926a-982f-4d42-a677-b8bf8a248b5c
13:49:48 LOGS_FOLDER=21556
13:49:48 XDG_SESSION_ID=1
13:49:48 JENKINS_HOME=/mnt/disks/sdb/jenkins
13:49:48 XDG_RUNTIME_DIR=/run/user/1008
13:49:48 ROOT_BUILD_CAUSE=GHPRBCAUSE
13:49:48 SSH_CLIENT=10.128.0.2 51582 22
13:49:48 ghprbGhRepository=kubernetes/minikube
13:49:48 ghprbPullId=21556
13:49:48 GIT_COMMIT=22a75abcad8af84f8217c5229473d3cf308d1656
13:49:48 NODE_LABELS=Ubuntu Agent 10 kvm kic-docker docker
13:49:48 BUILD_CAUSE_GHPRBCAUSE=true
13:49:48 WORKSPACE_TMP=/home/jenkins/workspace/Build_Cross@tmp
13:49:48 PATH=/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin
13:49:48 ghprbAuthorRepoGitUrl=https://github.com/ComradeProgrammer/minikube.git
13:49:48 RUN_ARTIFACTS_DISPLAY_URL=https://minikube-jenkins.corp.goog/job/Build_Cross/42239/display/redirect?page=artifacts
13:49:48 CI=true
13:49:48 ROOT_BUILD_CAUSE_GHPRBCAUSE=true
13:49:48 DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1008/bus
13:49:48 ghprbSourceBranch=kvm_prow
13:49:48 ghprbActualCommitAuthor=ComradeProgrammer
13:49:48 GIT_BRANCH=kvm_prow
13:49:48 BUILD_ID=42239
13:49:48 OLDPWD=/home/jenkins
13:49:48 GOPATH=/home/jenkins/go
13:49:48 _=/usr/bin/env
13:49:48 + cp -r hack/jenkins out/
13:49:48 + '[' -d hack/prow ']'
13:49:48 + cp hack/prow/run_tests.py out/
13:49:48 cp: cannot stat 'hack/prow/run_tests.py': No such file or directory
13:49:49 Build step 'Execute shell' marked build as failure
13:49:50 [Google Cloud Storage Plugin] Uploading: build.txt
13:49:51 Adding one-line test results to commit status...
13:49:51 Setting status of 55b3035fd89fbd57ee0b91c46039eb81f1287ceb to FAILURE with url https://storage.googleapis.com/minikube-builds/logs/21556/index.html and message: 'Build finished. No test results found.'
13:49:51 Using context: Jenkins Cross Build
13:49:52 [WS-CLEANUP] Deleting project workspace...
13:49:52 [WS-CLEANUP] Deferred wipeout is used...
13:49:52 [WS-CLEANUP] done
13:49:52 Finished: FAILURE

@k8s-ci-robot k8s-ci-robot removed the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Nov 7, 2025
@k8s-ci-robot
Copy link
Copy Markdown
Contributor

k8s-ci-robot commented Nov 7, 2025 •
edited
Loading

@ComradeProgrammer: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
integration-docker-containerd-linux-x86-64 3d9eb83 link true /test integration-docker-containerd-linux-x86-64
integration-docker-docker-linux-x86-64 3d9eb83 link true /test integration-docker-docker-linux-x86-64
integration-none-docker-linux-x86-64 3d9eb83 link true /test integration-none-docker-linux-x86-64
integration-docker-crio-linux-x86-64 3d9eb83 link true /test integration-docker-crio-linux-x86-64
integration-kvm-crio-linux-x86-64 3d9eb83 link true /test integration-kvm-crio-linux-x86-64
integration-kvm-containerd-linux-x86-64 3d9eb83 link true /test integration-kvm-containerd-linux-x86-64

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@minikube-pr-bot
Copy link
Copy Markdown

minikube-pr-bot commented Nov 7, 2025

kvm2 driver with docker runtime

┌────────────────┬──────────┬────────────────────────┐
│    COMMAND     │ MINIKUBE │ MINIKUBE  ( PR 21556 ) │
├────────────────┼──────────┼────────────────────────┤
│ minikube start │ 44.8s    │ 44.5s                  │
│ enable ingress │ 16.0s    │ 15.9s                  │
└────────────────┴──────────┴────────────────────────┘
Details

Times for minikube ingress: 15.9s 16.3s 16.3s 15.8s 15.7s
Times for minikube (PR 21556) ingress: 15.7s 16.2s 15.8s 15.8s 15.7s

Times for minikube (PR 21556) start: 43.9s 44.9s 43.2s 46.0s 44.5s
Times for minikube start: 45.1s 43.0s 45.3s 46.7s 43.9s

docker driver with docker runtime

┌────────────────┬──────────┬────────────────────────┐
│    COMMAND     │ MINIKUBE │ MINIKUBE  ( PR 21556 ) │
├────────────────┼──────────┼────────────────────────┤
│ minikube start │ 21.9s    │ 21.8s                  │
│ enable ingress │ 11.6s    │ 11.4s                  │
└────────────────┴──────────┴────────────────────────┘
Details

Times for minikube start: 20.8s 21.8s 22.4s 23.4s 20.9s
Times for minikube (PR 21556) start: 21.7s 24.2s 21.8s 20.8s 20.4s

Times for minikube ingress: 12.6s 10.6s 10.6s 10.6s 13.6s
Times for minikube (PR 21556) ingress: 10.6s 10.6s 13.6s 11.6s 10.6s

docker driver with containerd runtime

┌────────────────┬──────────┬────────────────────────┐
│    COMMAND     │ MINIKUBE │ MINIKUBE  ( PR 21556 ) │
├────────────────┼──────────┼────────────────────────┤
│ minikube start │ 20.6s    │ 20.4s                  │
│ enable ingress │ 21.1s    │ 20.9s                  │
└────────────────┴──────────┴────────────────────────┘
Details

Times for minikube start: 19.9s 20.6s 21.0s 21.2s 20.3s
Times for minikube (PR 21556) start: 23.3s 20.6s 19.6s 19.1s 19.3s

Times for minikube ingress: 20.1s 24.1s 20.1s 21.1s 20.1s
Times for minikube (PR 21556) ingress: 20.1s 20.1s 22.1s 21.1s 21.1s

@minikube-pr-bot
Copy link
Copy Markdown

minikube-pr-bot commented Nov 8, 2025

Here are the number of top 10 failed tests in each environments with lowest flake rate.

Environment Test Name Flake Rate
KVM_Linux_containerd (1 failed) TestNoKubernetes/serial/ProfileList(gopogh) 0.00% (chart)

Besides the following environments also have failed tests:

To see the flake rates of all tests by environment, click here.

@medyagh
Copy link
Copy Markdown
Member

medyagh commented Nov 8, 2025

/lgtm

@medyagh medyagh merged commit ad86e07 into kubernetes:master Nov 8, 2025
30 of 48 checks passed
@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Nov 8, 2025
@k8s-ci-robot
Copy link
Copy Markdown
Contributor

k8s-ci-robot commented Nov 8, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ComradeProgrammer, medyagh

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:
  • OWNERS [ComradeProgrammer,medyagh]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@medyagh medyagh mentioned this pull request Nov 17, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@medyagh medyagh medyagh requested changes

@nirs nirs Awaiting requested review from nirs

Assignees

@medyagh medyagh

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. ok-to-test Indicates a non-member PR verified by an org member that is safe to test. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Run Full KVM integration test in Prow

4 participants

@ComradeProgrammer @medyagh @k8s-ci-robot @minikube-pr-bot