Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Invoker] Check the file system disk space usage to avoid that invokers run out of space (cont.) #162

Merged

Conversation

steffenrost
Copy link

@steffenrost steffenrost commented Aug 16, 2023

Check the file system disk space usage to avoid that invokers run out of space. Make the max threshold values for root and logs filesystem configurable.

Description

Invoker pods may run out of space on their root and log volumes for very frequent scheduled actions producing a high load of log messages or because of many docker images which are not cleaned up. By this code change this situation is taken into consideration and the affected invoker will be temporary evacuated until the situation has been resolved. By this code change the file system occupation is checked every minute. Also the logic to do hysteresis has been removed as it interferes with the image monitor.

My changes affect the following components

  • API
  • Controller
  • Message Bus (e.g., Kafka)
  • Loadbalancer
  • Invoker
  • Intrinsic actions (e.g., sequences, conductors)
  • Data stores (e.g., CouchDB)
  • Tests
  • Deployment
  • CLI
  • General tooling
  • Documentation

Types of changes

  • Bug fix (generally a non-breaking change which closes an issue).
  • Enhancement or new feature (adds new functionality).
  • Breaking change (a bug fix or enhancement which changes existing behavior).

Checklist:

  • I signed an Apache CLA.
  • I reviewed the style guides and followed the recommendations (Travis CI will check :).
  • I added tests to cover my changes.
  • My changes require further changes to the documentation.
  • I updated the documentation where necessary.

Copy link

@falkzoll falkzoll left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks fine to me 👍 .

@falkzoll falkzoll mentioned this pull request Aug 24, 2023
21 tasks
@steffenrost steffenrost merged commit 9b76864 into ibm-functions:master Sep 11, 2023
1 check failed
@steffenrost steffenrost deleted the sr-blacklist-on-out-of-space-4 branch September 11, 2023 09:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants