Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Swift migration tests and remove fixed IP #710

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

cschwede
Copy link
Contributor

@cschwede cschwede commented Nov 8, 2024

The fixed IP is valid for CRC/standalone testing, however it is most likely not for any other deployments. Instead of using a fixed IP getting the IPs of the former storage nodes before adding PVCs will cover many more cases.

@jistr jistr added the to-backport Something to backport to a release branch. label Nov 8, 2024
@@ -25,7 +31,9 @@
{{ oc_header }}
oc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c '
swift-ring-tool get
swift-ring-tool drain 172.20.0.100
for node in {{ swift_node_list_result.stdout }}; do
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The content of swift_node_list_result.stdout is a newlines separate list, which breaks the shell interpretation as the items behind the first one creates new lines, apparently. Or at least it looks like from the logs:

fatal: [localhost]: FAILED! => {"changed": true, "cmd": "\noc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c '\nswift-ring-tool get\nfor node in 172.20.0.103\n172.20.0.104\n172.20.0.105; do\n swift-ring-tool drain ${node}\ndone\nswift-ring-tool forced_rebalance\nswift-ring-tool push'\n", "delta": "0:00:02.250242", "end": "2024-11-08 08:26:10.942126", "msg": "non-zero return code", "rc": 1, "start": "2024-11-08 08:26:08.691884", "stderr": "Starting pod/swift-ring-rebalance-debug-kwp8d, command was: /usr/local/bin/swift-ring-tool all\n\nRemoving debug pod ...\nerror: non-zero exit code from debug container", "stderr_lines": ["Starting pod/swift-ring-rebalance-debug-kwp8d, command was: /usr/local/bin/swift-ring-tool all", "", "Removing debug pod ...", "error: non-zero exit code from debug container"], "stdout": "Total bytes read: 122880 (120KiB, 33MiB/s)\n/bin/sh: -c: line 4: syntax error near unexpected token 172.20.0.104'\n/bin/sh: -c: line 4: 172.20.0.104'", "stdout_lines": ["Total bytes read: 122880 (120KiB, 33MiB/s)", "/bin/sh: -c: line 4: syntax error near unexpected token 172.20.0.104'", "/bin/sh: -c: line 4: 172.20.0.104'"]}

@@ -100,6 +108,8 @@
CONTROLLER1_SSH="{{ controller1_ssh }}"
oc debug --keep-labels=true job/swift-ring-rebalance -- /bin/sh -c '
swift-ring-tool get
swift-ring-tool remove 172.20.0.100
for node in {{ swift_node_list_result.stdout }}; do
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is probably affected by the same issue as above

The fixed IP is valid for CRC/standalone testing, however it is most
likely not for any other deployments. Instead of using a fixed IP
getting the IPs of the former storage nodes before adding PVCs will
cover many more cases.
@cschwede cschwede force-pushed the fix-swift-migration-remove-fixed-ip branch from 4cd07df to be4031a Compare November 18, 2024 17:04
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/76a557c7564d4d7eb7800056ece7d737

✔️ noop SUCCESS in 0s
adoption-standalone-to-crc-ceph RETRY_LIMIT in 23m 28s
adoption-standalone-to-crc-no-ceph RETRY_LIMIT in 22m 58s
✔️ adoption-docs-preview SUCCESS in 1m 14s

@cschwede
Copy link
Contributor Author

recheck

Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/8c3b591c0787459fa3248c38cb125211

✔️ noop SUCCESS in 0s
adoption-standalone-to-crc-ceph RETRY_LIMIT in 1h 00m 06s
adoption-standalone-to-crc-no-ceph RETRY_LIMIT in 13m 28s
✔️ adoption-docs-preview SUCCESS in 1m 26s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
to-backport Something to backport to a release branch.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants