Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IMPORTANT: evaluate VPN connection between Jenkins test CI and the Orka cluster #3883

Closed
8 of 9 tasks
UlisesGascon opened this issue Aug 31, 2024 · 3 comments · Fixed by #3888
Closed
8 of 9 tasks

Comments

@UlisesGascon
Copy link
Member

UlisesGascon commented Aug 31, 2024

As part of the Orka migration (#3686 (comment)), we need to connect our Jenkins Controllers (test and release) to the CISCO VPN.

We are not yet 100% sure how this might impact the current CI setup networking. I will be conducting some connectivity experiments this weekend when the CI is less used.

The goal is to avoid downtimes. I will be monitoring the impact on the infrastructure, but if you notice any issues, please include a comment in this issue.

Next Steps (Test CI Only):

  • Evaluate and document the current settings
  • Monitor the infrastructure
  • Install the dependencies
  • Manually enable the VPN connection
  • Evaluate and document the changes in the settings
  • Monitor the infrastructure
  • Disconnect the VPN connection after a few hours of testing or if any error is detected

Future Steps (Probably Next Week):

  • Add a script to auto-connect
  • Ensure the connection is restored when needed (reboot, refresh tokens, etc...)

Important

Currently, the changes will only take place in the test CI. Until this is stable, we won't make any changes to the release CI.

@UlisesGascon UlisesGascon self-assigned this Aug 31, 2024
@UlisesGascon UlisesGascon changed the title IMPORTANT: evaluatie VPN connection between Jenkins test CI and the Orka cluster IMPORTANT: evaluate VPN connection between Jenkins test CI and the Orka cluster Aug 31, 2024
@UlisesGascon
Copy link
Member Author

After some tweaks in the firewall and evaluating the changes in the network settings, seems like is stable. So far no incidents were detected. I created a service orka-vpn.service that can be used to manage it. 🥳

If no network errors are detected, I will mimic this setup on the release Jenkins Controller too.

@UlisesGascon
Copy link
Member Author

UlisesGascon commented Sep 2, 2024

So far this is stable, I am planning to add the release environment to the VPN too, following the same steps and creating a PR to document this manual steps as they are not done via Ansible.

I will start working on the release environment tomorrow.

@ryanaslett
Copy link
Contributor

The VPN on ci.nodejs.org stopped working as a result of the iptables rules being overwritten on a jenkins update and reboot.

The iptables rule to allow bidirectional connectivity is now in /etc/iptables/rules.v4 on both ci, and ci-release now and should now persist between reboots.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants