Update `build.yml` workflow to cross-compile linux binaries for `x86_64` and `aarch64` #140

afinetooth · 2024-08-13T22:49:24Z

Closes #137

⚡ Summary

Add aarch64 support to coverage-reporter.

Update build.yml workflow to cross-compile linux binaries for x86_64 and aarch64.

☑️ Checklist

Modify build.yml workflow to compile and upload linux binaries for x86_64 and aarch64
- New method utilizes docker buildx, removing the need for release_linux in the existing Makefile
- Modify existing Dockerfile to install additional dependencies required to build for x86_64 and aarch64

…aarch64.

coveralls-official · 2024-08-13T22:52:46Z

Pull Request Test Coverage Report for Build 10463164792

Warning: This coverage report may be inaccurate.

This pull request's base commit is no longer the HEAD commit of its target branch. This means it includes changes from outside the original pull request, including, potentially, unrelated coverage changes.

For more information on this, see Tracking coverage changes with pull request builds.
To avoid this issue with future PRs, see these Recommended CI Configurations.
For a quick fix, rebase this PR at GitHub. Your next report should be accurate.

Details

0 of 0 changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 93.983%

Totals
Change from base Build 10362720696:	0.0%
Covered Lines:	906
Relevant Lines:	964

💛 - Coveralls

…ability for cross-compilation.

…we'll use a basic Debian image and install ccrystal on it.

…t the correct executable filenames and paths.

…dist directory.

…k, we'll look at a different approach.

…n this path for now.

…d aarch64; uses community aarch64 docker images from 84codes.

…oid segfault.

…u-22.04-2xlarge.

… are provisioned.

…all.

… to default runner and split offending command into two calls to reduce memory usage.

…rnings and potentially memory usage, and add a check on diskspace just prior to the install steps to verify state.

…and remove upgrade step to save memory.

…memeory usage and potentially avoid segfault with builder-aarch64.

…says our setup looks fine.

… errors.

…ibc-bin: https://stackoverflow.com/questions/78105004/docker-build-fails-because-unable-to-install-libc-bin

…t-get install in noninteractive mode.

…bin: https://askubuntu.com/questions/975318/apt-get-segmentation-fault-error-processing-package-libc-bin && https://www.grepper.com/answers/426226/installed+libc-bin+package+post-installation+script+subprocess+returned+error+exit+status+134

…ous segfault error.

… shards.yml. Put back one required mv / rename step in release stage of workflow.

…dependencies and skip all problematic dependencies for aarch64 before running shards install again.

…ed dependencies isn't working for aarch64 install of crystal.

…to have been an error uploading my Dockerfile from before because my version is different from the latest. We'll see if that crops up again.

…ds install.

Update build workflow to cross-compile linux binaries for x86_64 and …

a15c384

…aarch64.

afinetooth changed the title ~~Update build workflow to cross-compile linux binaries for x86_64 and aarch64~~ Update build.yml workflow to cross-compile linux binaries for x86_64 and aarch64 Aug 13, 2024

afinetooth added 27 commits August 13, 2024 16:03

Modify Dockerfile to use Debian image, which has better package avail…

750fd07

…ability for cross-compilation.

Modify Dockerfile; debian image not available for crystal-1.13.1, so …

0e32e55

…we'll use a basic Debian image and install ccrystal on it.

Adjust paths to files created by BuildX.

20eeff0

Add a debug step printing out the contents of the /dist/ folder to ge…

1cf6a67

…t the correct executable filenames and paths.

Add another debug step to search for the binaries in the (very full) …

bf4607d

…dist directory.

Change Dockerfile to two-stage and modify the docker buildx command.

70928ec

Really trusting ths guidance of AI at this point. If this doesn't wor…

263ab79

…k, we'll look at a different approach.

Again, really trusting that we've gotten somewhere. This will be it o…

6eaf73b

…n this path for now.

Correct file download for Crystal.

a0e3fdd

Update Crystal install files.

614c750

Fix Crystal install.

932f603

Hopefully final changes to cross compile linux binaries for x86_64 an…

34f3e13

…d aarch64; uses community aarch64 docker images from 84codes.

Install dependency: libyaml.

827491d

Add dependency for x86_64: musl-dev.

c3c092a

Change dependency name: yaml-dev.

5742d0c

Change dependency name: libyaml.

e8f18bd

Change dependency name: yaml.

5a0bdb8

Change 84codes community images to ubuntu-22.04.

58fccd2

Add dependency: liblzma.

895498c

Try updating package before install to reduce memory footprint and av…

4859f26

…oid segfault.

Try running build-linux job on larger runner to avoid segfault: ubunt…

8d4ab8c

…u-22.04-2xlarge.

Update checkout and upload-artifact actions to latest version (v4).

9d7fb58

Change runner for build-linux to ubuntu-latest-m until larger runners…

0d29d16

… are provisioned.

Switch back to ubuntu-latest jsut to see if we can get any runner at …

2b80821

…all.

Try using a runner I just created for the repo.

5ef9a9e

Until we resolve issues with provisioning larger runners, switch back…

93b9591

… to default runner and split offending command into two calls to reduce memory usage.

Add DEBIAN_FRONTEND=noninteractive to installation calls to reduce wa…

629835f

…rnings and potentially memory usage, and add a check on diskspace just prior to the install steps to verify state.

afinetooth added 17 commits August 15, 2024 11:23

Install troublesome libc-bin separately to isolate potential issues, …

e379cbf

…and remove upgrade step to save memory.

Remove the apt-get upgrade step for builder-x86_64 to further reduce …

f98869e

…memeory usage and potentially avoid segfault with builder-aarch64.

Try using larger runner again, ubuntu-latest-m, after GitHub Support …

b549975

…says our setup looks fine.

Try a different standard GitHub runner.

81eef22

Try larger runner after confirming availability.

d82a7d1

Try an even larger runner. Still segfaulting.

085bb40

Drop back to standard runner since upgrading did not resolve segfault…

a3a05bd

… errors.

Try StackOverflow solution for persistent segfault error installing l…

ce0025e

…ibc-bin: https://stackoverflow.com/questions/78105004/docker-build-fails-because-unable-to-install-libc-bin

De-duplicate libc-bin install and modify found solution by running ap…

84e26de

…t-get install in noninteractive mode.

Change approach to improve cross-compilation process and avoid tenaci…

23737e1

…ous segfault error.

Remove redundant line from workflow file.

36af087

Manually remove dependencies so we don't reinstall them from a cached…

2ce202d

… shards.yml. Put back one required mv / rename step in release stage of workflow.

Separate Dockerfile steps to remove all previously installed Crystal …

b733468

…dependencies and skip all problematic dependencies for aarch64 before running shards install again.

Add debug step to Dockerfile to see why removal of previously install…

35dc3bb

…ed dependencies isn't working for aarch64 install of crystal.

Add --no-cache to build commands in workflow file. Also, there seems …

887a239

…to have been an error uploading my Dockerfile from before because my version is different from the latest. We'll see if that crops up again.

Try managing dependencies by modifying shards.yml and re-running shar…

57de29d

…ds install.

afinetooth merged commit 04f050e into master Aug 20, 2024
11 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update `build.yml` workflow to cross-compile linux binaries for `x86_64` and `aarch64` #140

Update `build.yml` workflow to cross-compile linux binaries for `x86_64` and `aarch64` #140

afinetooth commented Aug 13, 2024 •

edited

Loading

coveralls-official bot commented Aug 13, 2024 •

edited

Loading

Update build.yml workflow to cross-compile linux binaries for x86_64 and aarch64 #140

Update build.yml workflow to cross-compile linux binaries for x86_64 and aarch64 #140

Conversation

afinetooth commented Aug 13, 2024 • edited Loading

⚡ Summary

☑️ Checklist

coveralls-official bot commented Aug 13, 2024 • edited Loading

Pull Request Test Coverage Report for Build 10463164792

Warning: This coverage report may be inaccurate.

Details

💛 - Coveralls

Update `build.yml` workflow to cross-compile linux binaries for `x86_64` and `aarch64` #140

Update `build.yml` workflow to cross-compile linux binaries for `x86_64` and `aarch64` #140

afinetooth commented Aug 13, 2024 •

edited

Loading

coveralls-official bot commented Aug 13, 2024 •

edited

Loading