Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement Prometheus metrics for LocalQueue (#3673) #55

Open
wants to merge 57 commits into
base: dev
Choose a base branch
from

Conversation

KPostOffice
Copy link

cherry pick of local-queue metrics features

alculquicondor and others added 30 commits July 19, 2024 07:42
Change-Id: I1890352274a2cdb60b7e19b86386352ed0145983
…#2707)

* Add update-security-insights directive

* Use GIT_TAG instead of RELEASE_VERSION

---------

Co-authored-by: Irving Mondragón <[email protected]>
* Cleanup to use FlavorResourceQuantities.Add in cache (kubernetes-sigs#2696)

* fix: Refactor FitInCohort tests (kubernetes-sigs#2655)

* fix: Refactor FitInCohorot tests

* fix: delete no-op function

* fix: use new method to add usage

* fix: to enforce resource group constraint for flavors and resources

* fix: consolidated into a single resource group

* fix: delete flavorNames

* fix: adjusted test cases to align with existing expected conditions

* fix: change FlavorResourceQuantitiesFlat value

* Finish flattening of FlavorResourceQuantities (kubernetes-sigs#2721)

* Finish Flattenning FlavorResourceQuantities

* Rename FlavorResourceQuantitiesFlat to FlavorResourceQuantities

* Cleanup preemption.go (kubernetes-sigs#2800)

* [Partial Admission] Check Mode before attempting Preemption (kubernetes-sigs#2809)

* Prefer Reclamation to Priority Based Preemption (kubernetes-sigs#2811)

---------

Co-authored-by: s-shiraki <[email protected]>
* Move declaration of the Preempted reasons to API pkg

* Fix when PrioritySortingWithingCohort is disabled
…staging registry (kubernetes-sigs#2832)

* Publish images to new staging registry

* Update image registry name

---------

Co-authored-by: Irving Mondragón <[email protected]>
…ter deleting resource from (kubernetes-sigs#2879)

* Fixed overadmission after deleting resource from borrowing CQ.

* Removed filterLocalQueueUsage.

* Removed empty FlavorResourceQuantities objects on tests.
…hot clusterQueue. (kubernetes-sigs#2918)

* Deep clone ResourceGroups instead shallow copy on snapshot clusterQueue.

* Initialize ResourceGroups to the size of the original.

---------

Co-authored-by: Mykhailo Bobrovskyi <[email protected]>
Change-Id: I482b40fa841bcfa5b409425f3015b27723940b85
…ebhook on new CRDs availability (kubernetes-sigs#2991)

* Start Controller and Webhook on new CRDs availability

* Log errors from JobFramework controller and webhook

* Add test case for delayed JobFramework API becoming available

* Wait for API integration to be enabled

* Implement synchronization for safe concurrent access

* Implement exponential backoff for waitForAPI() and add function type to streamline REST mapping checks

* Add Job Framework API to mapper directly

* Cast mgr.GetRESTMapper() to *TestRESTMapper and ensure proper locking for tests
Copy link

openshift-ci bot commented Dec 10, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: KPostOffice

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

* add LocalQueue metrics (no feature gate)

Signed-off-by: Kevin <[email protected]>

* add all clear and report calls

Signed-off-by: Kevin <[email protected]>

* add feature gate

Signed-off-by: Kevin <[email protected]>

* cleanup todos and add more feature gates

Signed-off-by: Kevin <[email protected]>

* use feature gate instead of config

Signed-off-by: Kevin <[email protected]>

* cleanup

Signed-off-by: Kevin <[email protected]>

* add metrics checks to a test

Signed-off-by: Kevin <[email protected]>

* add lq metrics to cq integration test

Signed-off-by: Kevin <[email protected]>

* lint fix

Signed-off-by: Kevin <[email protected]>

* use name instead of local_queue

Signed-off-by: Kevin <[email protected]>

* update status metric description

Signed-off-by: Kevin <[email protected]>

* fix key name

Signed-off-by: Kevin <[email protected]>

* move registerLQ into metrics package

Signed-off-by: Kevin <[email protected]>

---------

Signed-off-by: Kevin <[email protected]>
@KPostOffice
Copy link
Author

/retest

@KPostOffice
Copy link
Author

/retest

@KPostOffice
Copy link
Author

I was debugging this test and noticed that the image being used when I ran the test was registry.k8s.io/kueue/kueue:v0.8.1 this version doesn't have the feature flag... but that confuses me. Shouldn't we be creating a new image based on the PR to run against when we run these tests so that the new changes are correctly tested?

@ChristianZaccaria ChristianZaccaria force-pushed the dev branch 3 times, most recently from 367ed20 to ce05603 Compare January 15, 2025 17:18
Copy link

openshift-ci bot commented Jan 15, 2025

@KPostOffice: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-odh-kueue b859cc2 link true /test e2e-odh-kueue
ci/prow/images b859cc2 link true /test images

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.