Add github workflow to run non-cloud tests with no approval [wip - do not review] #7400

vinayada1 · 2024-03-27T00:25:28Z

Description

Please explain the changes you've made.

Type of change

This pull request fixes a bug in Radius and has an approved issue (issue link required).
This pull request adds or changes features of Radius and has an approved issue (issue link required).
This pull request is a minor refactor, code cleanup, test improvement, or other maintenance task and doesn't change the functionality of Radius (issue link optional).

Fixes: #issue_number

radius-functional-tests · 2024-03-27T17:16:48Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`50566ce`
Unique ID	func17eb1c930d
Image tag	pr-func17eb1c930d

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-func17eb1c930d
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func17eb1c930d
controller test image location: ghcr.io/radius-project/dev/controller:pr-func17eb1c930d
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func17eb1c930d
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting msgrp functional tests...
⌛ Starting cli functional tests...
⌛ Starting datastoresrp functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting samples functional tests...
⌛ Starting ucp functional tests...
✅ msgrp functional tests succeeded
✅ kubernetes functional tests succeeded
✅ samples functional tests succeeded
✅ daprrp functional tests succeeded
✅ ucp functional tests succeeded
✅ cli functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ shared functional tests succeeded

radius-functional-tests · 2024-03-27T18:20:32Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`ccbfc84`
Unique ID	func9926820db6
Image tag	pr-func9926820db6

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-func9926820db6
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func9926820db6
controller test image location: ghcr.io/radius-project/dev/controller:pr-func9926820db6
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func9926820db6
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting cli functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting ucp functional tests...
⌛ Starting samples functional tests...
⌛ Starting datastoresrp functional tests...
✅ msgrp functional tests succeeded
✅ kubernetes functional tests succeeded
✅ samples functional tests succeeded
✅ ucp functional tests succeeded
✅ daprrp functional tests succeeded
✅ cli functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ shared functional tests succeeded

rynowak · 2024-03-28T19:46:14Z

.github/workflows/functional-test-noncloud.yaml

+# ------------------------------------------------------------
+
+name: Functional tests with no cloud resources
+


Can we consolidate this with some of the other workflows? (why or why not?). Without adding more complexity we're going to have at least 3 flavors:

Scheduled Azure tests

PR-based non-cloud functional tests

PR-based functional tests

I'm just thinking about how we can make this more maintainable. Do you have ideas?

codecov · 2024-04-10T22:37:23Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 61.00%. Comparing base (ea316f3) to head (e181140).

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #7400   +/-   ##
=======================================
  Coverage   61.00%   61.00%           
=======================================
  Files         517      517           
  Lines       26514    26514           
=======================================
  Hits        16176    16176           
  Misses       8916     8916           
  Partials     1422     1422

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

radius-functional-tests · 2024-05-16T21:09:43Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`cc53b3a`
Unique ID	funce2d9e31876
Image tag	pr-funce2d9e31876

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-funce2d9e31876
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-funce2d9e31876
controller test image location: ghcr.io/radius-project/dev/controller:pr-funce2d9e31876
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-funce2d9e31876
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting ucp functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting datastoresrp functional tests...
⌛ Starting shared functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting cli functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting samples functional tests...
✅ ucp functional tests succeeded
✅ msgrp functional tests succeeded
✅ kubernetes functional tests succeeded
✅ samples functional tests succeeded
✅ daprrp functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ cli functional tests succeeded
✅ shared functional tests succeeded

Signed-off-by: vinayada1 <[email protected]>

ytimocin · 2024-08-01T16:15:47Z

Fixed in this PR.

vinayada1 requested review from a team as code owners March 27, 2024 00:25

vinayada1 changed the title ~~Add github workflow to run non-cloud tests with no approval [wip]~~ Add github workflow to run non-cloud tests with no approval [wip - do not review] Mar 27, 2024

vinayada1 temporarily deployed to functional-tests March 27, 2024 17:16 — with GitHub Actions Inactive

vinayada1 force-pushed the separate-test branch 2 times, most recently from 34dfce5 to ccbfc84 Compare March 27, 2024 18:19

vinayada1 temporarily deployed to functional-tests March 27, 2024 18:19 — with GitHub Actions Inactive

vinayada1 force-pushed the separate-test branch from ccbfc84 to 69ed735 Compare March 27, 2024 18:25

rynowak reviewed Mar 28, 2024

View reviewed changes

vinayada1 had a problem deploying to functional-tests May 10, 2024 22:26 — with GitHub Actions Failure

vinayada1 force-pushed the separate-test branch from 97bcd8f to cc53b3a Compare May 16, 2024 17:48

vinayada1 temporarily deployed to functional-tests May 16, 2024 21:09 — with GitHub Actions Inactive

vinayada1 added 5 commits May 21, 2024 15:38

Add github workflow to run non-cloud tests with no approval

051f360

Signed-off-by: vinayada1 <[email protected]>

always run build job

664b4c1

Signed-off-by: vinayada1 <[email protected]>

init

128aa61

Signed-off-by: vinayada1 <[email protected]>

Modify existing workflow to run cloud/non-cloud tests

93fd6cf

Modify workflow trigger and makefile for build options

e181140

vinayada1 force-pushed the separate-test branch from 6a7ad26 to e181140 Compare May 21, 2024 22:39

vinayada1 had a problem deploying to functional-tests June 20, 2024 22:39 — with GitHub Actions Failure

ytimocin closed this Aug 1, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add github workflow to run non-cloud tests with no approval [wip - do not review] #7400

Add github workflow to run non-cloud tests with no approval [wip - do not review] #7400

vinayada1 commented Mar 27, 2024

radius-functional-tests bot commented Mar 27, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 27, 2024 •

edited

Loading

rynowak Mar 28, 2024

codecov bot commented Apr 10, 2024 •

edited

Loading

radius-functional-tests bot commented May 16, 2024 •

edited

Loading

ytimocin commented Aug 1, 2024

		# ------------------------------------------------------------

		name: Functional tests with no cloud resources

Add github workflow to run non-cloud tests with no approval [wip - do not review] #7400

Add github workflow to run non-cloud tests with no approval [wip - do not review] #7400

Conversation

vinayada1 commented Mar 27, 2024

Description

Type of change

radius-functional-tests bot commented Mar 27, 2024 • edited Loading

Radius functional test overview

Test Status

radius-functional-tests bot commented Mar 27, 2024 • edited Loading

Radius functional test overview

Test Status

rynowak Mar 28, 2024

Choose a reason for hiding this comment

codecov bot commented Apr 10, 2024 • edited Loading

Codecov Report

radius-functional-tests bot commented May 16, 2024 • edited Loading

Radius functional test overview

Test Status

ytimocin commented Aug 1, 2024

radius-functional-tests bot commented Mar 27, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 27, 2024 •

edited

Loading

codecov bot commented Apr 10, 2024 •

edited

Loading

radius-functional-tests bot commented May 16, 2024 •

edited

Loading