Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[main] ObjectRetrierWraps fixes (cherry-pick #1234) #1237

Merged
merged 8 commits into from
Jul 2, 2024

Conversation

ajkavanagh
Copy link
Collaborator

Picked from #1234

  • Add ObjectRetrier to CinderaBackupTests
  • Add additional debug for ObjectRetrier
  • Re-enable test 410 for cinder backups
  • Fix ObjectRetrierWraps recursive wrapping
  • Double Cinder backup restore time
  • Add more retries to allow manila backup restore to complete
  • Reduce ObjectRetrierWraps logging noise during normal use
  • Modify test code to be less brittle

This adds the auto-retrier to the cinder client to get past race hazards
and other transient errors.
It wasn't capturing member variables on the wrapped object that would
then be used to make the call; thus, wrap those.

This also disables (temporarily) the long running cinder backup test
deletion whilst checking whether retries are the problem.
This is to verify that the retries really do work.
In order to ensure that an object that contains other objects that are
called (e.g. the VolumeManager object on the Cinder client object), the
ObjectRetrierWraps class needs to more agressively wrap non builtin
classes.
This accounts for slow ServerStack when using ceph in the model.
Due to slow 1GiB networking in ServerStack the restore often exceeds the
retries.  Increase them to enable the restore to succeed.
The test for log function against ObjectRetrierWraps class is too
brittle to the number of log calls. This commit makes it less brittle.
@ajkavanagh ajkavanagh changed the title [pick #1234] ObjectRetrierWraps fixes [main] [pick #1234] ObjectRetrierWraps fixes Jul 2, 2024
@ajkavanagh ajkavanagh changed the title [main] [pick #1234] ObjectRetrierWraps fixes [main] ObjectRetrierWraps fixes (cherry-pick #1234) Jul 2, 2024
@wolsen wolsen merged commit e67dca5 into master Jul 2, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants