Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add kubernetes-1.29 package and variants #3628

Merged
merged 2 commits into from
Jan 8, 2024

Conversation

gthao313
Copy link
Member

@gthao313 gthao313 commented Nov 29, 2023

Issue number:

Description of changes:
This adds the package for K8s 1.29 for building kubelet and new 1.29 Bottlerocket variants.

Testing done:

  • aarch64 IPv4 conformance tests
  • aarch64 IPv6 conformance tests
  • aarch64 NVIDIA conformance tests
  • aarch64 NVIDIA smoke tests
  • x86_64 IPv4 conformance tests
  • x86_64 IPv6 conformance tests
  • x86_64 NVIDIA conformance tests
  • x86_64 NVIDIA smoke tests
[cargo-make][1] INFO - Running Task: testsys
 NAME                                                                         TYPE                                    STATE                                                                 PASSED                                FAILED                                SKIPPED   BUILD ID                                LAST UPDATE
 aarch64-aws-k8s-129-conformance-test                                         Test                                    passed                                                                   390                                     2                                   7019                                           2023-12-21T07:01:42Z
                                                                                                                                                                                                 4                                     0                                   7407
 aarch64-aws-k8s-129-ipv6-conformance-test                                    Test                                    passed                                                                   388                                     4                                   7019                                           2023-12-21T06:54:43Z
                                                                                                                                                                                                 4                                     0                                   7407
 aarch64-aws-k8s-129-nvidia-conformance-test                                  Test                                    passed                                                                   392                                     0                                   7019                                           2023-12-21T06:54:27Z
 aarch64-aws-k8s-129-nvidia-nvidia-smoke-test                                 Test                                    passed                                                                    11                                     0                                      0                                           2023-12-21T04:49:43Z
 x86-64-aws-k8s-129-conformance-test                                          Test                                    passed                                                                   392                                     0                                   7019                                           2023-12-21T00:35:26Z
 x86-64-aws-k8s-129-ipv6-conformance-test                                     Test                                    passed                                                                   392                                     0                                   7019                                           2023-12-21T00:50:31Z
 x86-64-aws-k8s-129-nvidia-conformance-test                                   Test                                    passed                                                                   392                                     0                                   7019                                           2023-12-21T01:00:53Z
 x86-64-aws-k8s-129-nvidia-nvidia-smoke-test                                  Test                                    passed                                                                    11                                     0                                      0                                           2023-12-20T23:11:53Z
 aarch64-aws-k8s-129-instances                                                Resource                                completed                                                                                                                                                                                           2023-12-21T04:40:18Z
 aarch64-aws-k8s-129-ipv6-instances                                           Resource                                completed                                                                                                                                                                                           2023-12-21T04:38:52Z
 aarch64-aws-k8s-129-nvidia-instances                                         Resource                                completed                                                                                                                                                                                           2023-12-21T04:47:11Z
 x86-64-aws-k8s-129-instances                                                 Resource                                completed                                                                                                                                                                                           2023-12-20T22:45:55Z
 x86-64-aws-k8s-129-ipv6-instances                                            Resource                                completed                                                                                                                                                                                           2023-12-20T22:52:29Z
 x86-64-aws-k8s-129-nvidia-instances                                          Resource                                completed                                                                                                                                                                                           2023-12-20T23:09:20Z
  • metal conformance test
NAME                                    STATUS   ROLES           AGE     VERSION
x86-64-metal-k8s-128-blxmb              Ready    control-plane   27m     v1.29.0-eks-a5ec690
x86-64-metal-k8s-128-md-0-l6t9j-gndv8   Ready    <none>          6m      v1.29.0-eks-a5ec690
x86-64-metal-k8s-128-md-0-l6t9j-hfdkw   Ready    <none>          5m47s   v1.29.0-eks-a5ec690

➜  metal  sonobuoy results ${result}
Plugin: e2e
Status: passed
Total: 7393
Passed: 384
Failed: 0
Skipped: 7009
  • vmware conformance test
➜  vmware  sonobuoy results 202312212108_sonobuoy_88b39c55-9041-4dc8-b3ba-9628e2423a55.tar.gz
Plugin: e2e
Status: passed
Total: 7393
Passed: 384
Failed: 0
Skipped: 7009
  • EBS driver testing
$ kubectl --kubeconfig x86-64-aws-k8s-129-ipv6.kubeconfig  get pods -n kube-system -l app.kubernetes.io/name=aws-ebs-csi-driver
NAME                                READY   STATUS    RESTARTS   AGE
ebs-csi-controller-c5fc7f7b-2pp9h   6/6     Running   0          6m27s
ebs-csi-controller-c5fc7f7b-cbglt   6/6     Running   0          6m27s
ebs-csi-node-688vp                  3/3     Running   0          6m27s
ebs-csi-node-c7k2h                  3/3     Running   0          6m27s
tianhg@ip-172-31-46-34 bottlerocket]$  kubectl get pod
NAME     READY   STATUS    RESTARTS   AGE
credential-test   1/1     Running   0          109m

Terms of contribution:

By submitting this pull request, I agree that this contribution is dual-licensed under the terms of both the Apache License, version 2.0, and the MIT license.

packages/kubernetes-1.29/Cargo.toml Outdated Show resolved Hide resolved
sources/models/src/lib.rs Show resolved Hide resolved
@gthao313
Copy link
Member Author

gthao313 commented Jan 2, 2024

New Kubernetes requires go1.21 or greater, and the go version at SDK 0.36.1 is 1.20. Therefore the CI build failed. Current We're working on bumping the Go version to 1.21.

For the testing, I was using SDK 0.36.0 which has go1.21.

@gthao313
Copy link
Member Author

gthao313 commented Jan 4, 2024

^ addressed comments.

I'll re-test it with new SDK.

@gthao313 gthao313 requested a review from bcressey January 4, 2024 19:16
@jpculp jpculp mentioned this pull request Jan 4, 2024
11 tasks
sources/models/README.md Outdated Show resolved Hide resolved
This adds a k8s-1.29 package. Existing 1.28 models are moved to be 1.29,
with symlinks created for 1.28 models to point to the new locations.
Finally, new variants are defined for aws-k8s-1.29, aws-k8s-1.29-nvidia,
metal-k8s-1.29, and vmware-k8s-1.29.
@gthao313
Copy link
Member Author

gthao313 commented Jan 7, 2024

Test result with new SKD
aws-k8s

 NAME                                                           TYPE                       STATE                                      PASSED                  FAILED                  SKIPPED   BUILD ID                  LAST UPDATE
 aarch64-aws-k8s-129-conformance-test                           Test                       passed                                        390                       2                     7019                             2024-01-05T21:54:58Z
                                                                                                                                           4                       0                     7407
 aarch64-aws-k8s-129-ipv6-conformance-test                      Test                       passed                                        390                       2                     7019                             2024-01-05T21:47:19Z
                                                                                                                                           4                       0                     7407
 aarch64-aws-k8s-129-nvidia-conformance-test                    Test                       passed                                        392                       0                     7019                             2024-01-06T00:39:33Z
 aarch64-aws-k8s-129-nvidia-nvidia-smoke-test                   Test                       passed                                         11                       0                        0                             2024-01-05T22:40:47Z
 x86-64-aws-k8s-129-conformance-test                            Test                       passed                                        392                       0                     7019                             2024-01-05T21:28:53Z
 x86-64-aws-k8s-129-ipv6-conformance-test                       Test                       passed                                        392                       0                     7019                             2024-01-05T21:38:36Z
 x86-64-aws-k8s-129-nvidia-conformance-test                     Test                       running                                         0                       0                        0                             2024-01-06T01:18:56Z
 x86-64-aws-k8s-129-nvidia-nvidia-smoke-test                    Test                       running                                         0                       0                        0                             2024-01-06T01:18:54Z
 aarch64-aws-k8s-129-instances                                  Resource                   completed                                                                                                                      2024-01-05T19:37:08Z
 aarch64-aws-k8s-129-ipv6-instances                             Resource                   completed                                                                                                                      2024-01-05T19:37:37Z
 aarch64-aws-k8s-129-nvidia-instances                           Resource                   completed                                                                                                                      2024-01-05T22:38:19Z
 x86-64-aws-k8s-129-instances                                   Resource                   completed                                                                                                                      2024-01-05T19:35:19Z
 x86-64-aws-k8s-129-ipv6-instances                              Resource                   completed                                                                                                                      2024-01-05T19:36:22Z
 x86-64-aws-k8s-129-nvidia-instances                            Resource                   completed                                                                                                                      2024-01-06T01:18:50Z

metal-k8s

br@br-admin:~/1.29-release/baremetal/eksa-colo$ kubectl get node --kubeconfig br-128/br-128-eks-a-cluster.kubeconfig
NAME                      STATUS   ROLES           AGE   VERSION
br-128-c94kh              Ready    control-plane   46h   v1.29.0-eks-a5ec690
br-128-md-0-7jhgq-p6zjz   Ready    <none>          46h   v1.29.0-eks-a5ec690
br-128-md-0-7jhgq-x77r2   Ready    <none>          46h   v1.29.0-eks-a5ec690

   PLUGIN     STATUS   RESULT   COUNT                                PROGRESS
      e2e   complete   passed       1   Passed:380, Failed:  0, Remaining:  0

Sonobuoy has completed. Use `sonobuoy retrieve` to get results.
Plugin: e2e
Status: passed
Total: 7393
Passed: 384
Failed: 0
Skipped: 7009

vmware-k8s

➜  vmware  sonobuoy results 202401072109_sonobuoy_fde85e40-50ff-4ea2-b99d-c9146a60bf36.tar.gz
Plugin: e2e
Status: passed
Total: 7393
Passed: 384
Failed: 0
Skipped: 7009

@gthao313 gthao313 merged commit 0935afb into bottlerocket-os:develop Jan 8, 2024
52 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants