37 Commits

Author SHA1 Message Date
Brad Davidson
c40bb449ba Fix rootless e2e test
The install script was starting the service, and then the test itself was restarting it immediately thereafter, which caused frequent flakes.

Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2025-06-12 17:17:49 -07:00
Derek Nola
4e8d85a2e4 Split E2E Drone pipeline into matrix (#12086)
* Split drone e2e into multiple blocks, explicit virsh cleanup

* Create multiple registries once and reuse as long as they exist

Signed-off-by: Derek Nola <derek.nola@suse.com>
2025-04-14 13:44:48 -07:00
Derek Nola
380a70ac7e Expand E2E test matrix to cover all possible tests that fit on GHA
Fix rootless test

Fix svc firewall E2E test, broken by #11711

Signed-off-by: Derek Nola <derek.nola@suse.com>
2025-02-28 08:46:10 -08:00
Derek Nola
9be40761d7 Reduce the number of GH api request for E2E nightly (#11148)
Signed-off-by: Derek Nola <derek.nola@suse.com>
2024-10-23 09:36:06 -07:00
Derek Nola
c0d661b334 Check the last 10 commits for upgrade E2E test (#11086)
Signed-off-by: Derek Nola <derek.nola@suse.com>
2024-10-16 12:22:38 -07:00
Derek Nola
ac247d29cf Update to newer OS images for install testing (#10681)
* Update to newer OS images for install testing
* Update vagrant images used for E2E

Signed-off-by: Derek Nola <derek.nola@suse.com>
2024-08-12 09:26:19 -07:00
dependabot[bot]
4cb4542c3a Bump ubuntu from 22.04 to 24.04 in /tests/e2e/scripts
Bumps ubuntu from 22.04 to 24.04.

---
updated-dependencies:
- dependency-name: ubuntu
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-05-28 20:12:14 -07:00
Derek Nola
0981f0069d Add E2E Split Server to Drone, support parrallel testing in Drone (#9940)
* Fix SE old test name
* E2E: support multiple VMs at once in CI with time prefix
* Add local binary support to split server test, add to drone CI
* Cleanup old VMs in drone

Signed-off-by: Derek Nola <derek.nola@suse.com>
2024-04-29 13:57:22 -07:00
Derek Nola
c47c85e5da Move to ubuntu 23.10 for E2E tests (#9755)
Signed-off-by: Derek Nola <derek.nola@suse.com>
2024-03-27 09:55:13 -07:00
Derek Nola
af4c51bfc3 Move to ubuntu 2204 for all E2E tests
Simplify node roles

Signed-off-by: Derek Nola <derek.nola@suse.com>
2024-03-06 14:04:05 -08:00
Ian Cardoso
df5e983fc8 add e2e startup test for rootless k3s (#8383)
* add test for rootless k3s

Signed-off-by: Ian Cardoso <osodracnai@gmail.com>

* fix comments

Signed-off-by: Ian Cardoso <osodracnai@gmail.com>

* Cleanup rootless e2e test, simplify logic

Signed-off-by: Derek Nola <derek.nola@suse.com>

---------

Signed-off-by: Ian Cardoso <osodracnai@gmail.com>
Signed-off-by: Derek Nola <derek.nola@suse.com>
Co-authored-by: Derek Nola <derek.nola@suse.com>
2024-01-09 10:39:54 -08:00
ShylajaDevadiga
8ec7d5e6b0 fix_get_sha_url (#7187)
Signed-off-by: ShylajaDevadiga <shylaja@rancher.com>
2023-03-31 13:26:29 -07:00
Derek Nola
9980504196 Fix to Rotate CA e2e test (#7101)
* Include note on service keys

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Fix rotate cert ca test

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Remove periods

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Add new test to nightly script

Signed-off-by: Derek Nola <derek.nola@suse.com>

---------

Signed-off-by: Derek Nola <derek.nola@suse.com>
2023-03-16 17:56:17 -07:00
Derek Nola
522ad1e697 Add E2E to Drone (#6890)
* Initial drone vagrant pipeline

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Build e2e test image

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Add docker registry to E2E pipeline

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Bump libvirt image

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Add ci flag to secretsencryption

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Fix vagrant log on secretsencryption

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Remove DB parallel tests

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Reduce sonobuoy tests even further

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Add local build

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Add cron conformance pipeline

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Add string output for nodes

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Switch snapshot restore for upgrade cluster

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Fix cp

Signed-off-by: Derek Nola <derek.nola@suse.com>

---------

Signed-off-by: Derek Nola <derek.nola@suse.com>
2023-03-10 19:53:41 -08:00
Derek Nola
7cad3db251 E2E: Consoldiate docker and prefer bundled tests into new startup test (#6851)
* Convert docker E2E to startup E2E
* Move preferedbundled into the e2e startup test

Signed-off-by: Derek Nola <derek.nola@suse.com>
2023-02-06 10:39:46 -08:00
Derek Nola
75f77ab951 E2E Rancher and Hardened script improvements (#6778)
* Improve test-pad rancher script

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Improve hardened script and added kube-bench utility script

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Apply same audits for 1.22 and older

Signed-off-by: Derek Nola <derek.nola@suse.com>

Signed-off-by: Derek Nola <derek.nola@suse.com>
2023-01-26 18:17:33 -08:00
ShylajaDevadiga
2007cdd54f generate report and upload test results (#6737)
Signed-off-by: ShylajaDevadiga <shylaja.devadiga@suse.com>

Signed-off-by: ShylajaDevadiga <shylaja.devadiga@suse.com>
Co-authored-by: ShylajaDevadiga <shylaja.devadiga@suse.com>
2023-01-18 09:34:52 -08:00
dependabot[bot]
d85952d6a0 Bump ubuntu from 20.04 to 22.04 in /tests/e2e/scripts (#6686)
Bumps ubuntu from 20.04 to 22.04.

---
updated-dependencies:
- dependency-name: ubuntu
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-12 13:57:28 -08:00
ShylajaDevadiga
fd8481a29d Adjust e2e test run script and fixes (#6718)
Signed-off-by: ShylajaDevadiga <shylaja.devadiga@suse.com>
2023-01-11 16:09:45 -08:00
Sakala Venkata Krishna Rohit
4e2e91e089 Switch from Google Buckets to AWS S3 Buckets (#6497)
* Add python pip pakacge to install aws cli

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Upload build artifacts to aws s3 instead of gcp bucket

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Upload logs to aws s3 instead of google buckets

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Replace gcloud auth with aws credentials for artifact uploading to buckets

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Replace usage of google bucket with aws s3 buckets

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>
2022-11-28 19:27:43 +02:00
ShylajaDevadiga
b276b58175 Convert test output to JSON format (#6410)
* add test output conversion to JSON and minor fixes

Signed-off-by: ShylajaDevadiga <shylaja@rancher.com>
2022-11-04 16:07:12 -07:00
ShylajaDevadiga
d3c675f4e9 Expand nightly E2E tests (#6354)
Signed-off-by: Shylaja Devadiga <shylaja@rancher.com>
2022-10-31 11:02:44 -07:00
Manuel Buil
6b804fe224 Add the gateway parameter in netplan
Signed-off-by: Manuel Buil <mbuil@suse.com>
2022-10-18 13:14:10 +02:00
Manuel Buil
dd3f3dba92 Fix dualStack test
Signed-off-by: Manuel Buil <mbuil@suse.com>
2022-10-10 10:52:30 +02:00
Derek Nola
5629c06967 Remove docker login secret, move to docker registry cache
Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-09-19 15:31:02 -07:00
Derek Nola
a43c948e01 add vagrant-scp to init script
Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-09-13 14:17:39 -07:00
Derek Nola
551b2c3cea Cleanup init and run_test scripts
Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-09-13 14:17:39 -07:00
Derek Nola
75f8cfb6ea E2E: Local cluster testing (#5977)
* Cleanup validatecluster printout
* remove deprecated kubectl exec format
* Implement CreateLocalCluster function
* Update testing documentation

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-08-15 15:00:22 -07:00
ShylajaDevadiga
30fc909581 Update run scripts (#5979)
Signed-off-by: Shylaja Devadiga <shylaja@rancher.com>
2022-08-10 15:30:57 -07:00
ShylajaDevadiga
6b7b9c5aa9 Add scripts to run e2e test using ansible (#5134)
Signed-off-by: Shylaja Devadiga <shylaja.devadiga@suse.com>
2022-08-05 09:16:10 -07:00
Derek Nola
12695cea15 E2E: Dualstack test (#5617)
* E2E dualstack test
* Improve testing documentation

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-06-14 08:40:29 -07:00
Derek Nola
efab09bc1f E2E Improvements and groundwork for test-pad tool (#5593)
* Add rancher install sript, taints to cp/etcd roles
* Revert back to generic/ubuntu2004, libvirt networking is unreliable on opensuse
* Added support for alpine
* Rancher deployment script
* Refactor installType into function
* Cleanup splitserver test
Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-06-13 13:36:26 -07:00
Derek Nola
809f0cf05b Added option to deploy hardened k3s (#5415)
Added option to deploy hardened k3s

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-04-14 15:00:48 -07:00
Derek Nola
38ed1a6750 E2E Add external DB options to ValidateCluster test (#5157)
* Initial mysql, postgres external db
* Convert test options to env variables
* Add explicit ETCD option and bump memory for docker node

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-03-02 12:42:55 -08:00
Derek Nola
830c330aad E2E Test Improvements (#5102)
* Fix infinite while loop on failure, reduce upgradecluster

* DRY code

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-02-10 09:27:00 -08:00
Derek Nola
9bd101c120 Add new upgradecluster E2E test (#4900)
* validatecluster fixes

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-01-19 18:48:59 -08:00
Shylaja Devadiga
4f03532f47 Add nightly automation tests
Signed-off-by: Shylaja Devadiga <shylaja@rancher.com>
2021-07-30 11:43:28 -07:00