Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf: rsync everything is brittle #300

Open
marten-seemann opened this issue Sep 7, 2023 · 0 comments
Open

perf: rsync everything is brittle #300

marten-seemann opened this issue Sep 7, 2023 · 0 comments

Comments

@marten-seemann
Copy link
Contributor

marten-seemann commented Sep 7, 2023

The runner syncs the current state of the directory to the EC2 instances:

const stdout = execCommand(`rsync -avz --progress --filter=':- .gitignore' -e "ssh -o StrictHostKeyChecking=no" ../impl ec2-user@${ip}:/home/ec2-user`);
console.error(stdout.toString());

This means that if you've built the implementations locally, the binaries will be synced to the server as well. Apparently, these binaries aren't overwritten by the build process, leading to inconsistent state. And, if you're building on a different architecture, those binaries can't be executed.

Possible solutions: Be more careful what to sync to the server. One way to do that could be obtaining the list of files tracked by Git, and only syncing those. Or alternatively, exclude the files ignored by Git, or at the very least blacklist the build outputs.

@marten-seemann marten-seemann changed the title perf: runner setup is brittle perf: rsync everything is brittle Sep 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant