Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow remote shared cache testing from a network isolated sandbox #1498

Merged
merged 23 commits into from
Jan 5, 2024
Merged

Allow remote shared cache testing from a network isolated sandbox #1498

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
06b35e5
basic working prototype
JakeSiFive Dec 27, 2023
86958b8
a few more changes to clean things up
JakeSiFive Jan 2, 2024
28232d6
lots of good cleanup things
JakeSiFive Jan 4, 2024
6a9d931
Add github actions testing for postgres testing
JakeSiFive Jan 4, 2024
ce5c06d
add postgres to host deps
JakeSiFive Jan 4, 2024
047e3b4
correct postgres package name
JakeSiFive Jan 4, 2024
908d9cb
Try to get ubuntu working by setting it explicitly
JakeSiFive Jan 4, 2024
ec478a8
Run cargo vendor first
JakeSiFive Jan 4, 2024
fd03d5f
whoops wrong dir
JakeSiFive Jan 4, 2024
b6d4bf9
Checkout postgres directly
JakeSiFive Jan 5, 2024
ee5468a
checkout commit hash
JakeSiFive Jan 5, 2024
9c3e58d
remeber to CD!
JakeSiFive Jan 5, 2024
ad81647
fix several issues lol
JakeSiFive Jan 5, 2024
e9c7c92
format
JakeSiFive Jan 5, 2024
87a5939
fail faster while debugging, change configure prefix
JakeSiFive Jan 5, 2024
6b03f04
don't worry about formatting for now
JakeSiFive Jan 5, 2024
152cd47
Use /var/tmp for checkout and install
JakeSiFive Jan 5, 2024
1492276
Forgot to vendor deps
JakeSiFive Jan 5, 2024
6a0a54e
use pushd/popd
JakeSiFive Jan 5, 2024
6fc7834
Fix bad exit trap; use our own raw rust instead of rustup
JakeSiFive Jan 5, 2024
3788d9b
forgot to specify remote in git fetch
JakeSiFive Jan 5, 2024
cfd62ac
clean up a bit
JakeSiFive Jan 5, 2024
4e4dbb0
more clean up
JakeSiFive Jan 5, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 15 additions & 18 deletions .github/workflows/build.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,21 @@ jobs:
with:
fetch-depth: 0

- name: Install Deps
run: sudo apt-get update && sudo apt-get install -y build-essential fuse libfuse-dev libsqlite3-dev libgmp-dev libncurses5-dev pkg-config git g++ gcc libre2-dev python3-sphinx clang-format-12 postgresql

- name: Check C/C++ Formatting
run: clang-format-12 --style=file --Werror -n $(./scripts/which_clang_files all)

- name: Build Tarball
run: make tarball

- name: Run Tests
run: make test && make unittest

- name: Check Wake Formatting
run: ./bin/wake-format.native-cpp14-release --auto --dry-run

- name: Download rust
run: pushd /var/tmp && wget https://static.rust-lang.org/dist/rust-1.72.0-x86_64-unknown-linux-gnu.tar.gz && popd

Expand All @@ -33,27 +48,9 @@ jobs:
- name: Build postgres
run: pushd /var/tmp/postgres && ./configure --prefix /var/tmp/pg-server && make install && popd

- name: Install Deps
run: sudo apt-get update && sudo apt-get install -y build-essential fuse libfuse-dev libsqlite3-dev libgmp-dev libncurses5-dev pkg-config git g++ gcc libre2-dev python3-sphinx clang-format-12 postgresql

- name: Vendor remote cache deps
run: cd rust/rsc && cargo vendor --locked
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks like you deleted too much


- name: Run Remote Cache Tests
run: POSTGRES_DIR=/var/tmp/pg-server CARGO_HOME=/var/tmp/rust-install make remoteCacheTests

- name: Check C/C++ Formatting
run: clang-format-12 --style=file --Werror -n $(./scripts/which_clang_files all)

- name: Build Tarball
run: make tarball

- name: Run Tests
run: make test && make unittest

- name: Check Wake Formatting
run: ./bin/wake-format.native-cpp14-release --auto --dry-run

- name: Generate Docs
run: mkdir www && ./bin/wake --no-workspace --html > www/index.html

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/dockerfiles/alpine
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM alpine:3.14.0

RUN apk add m4 g++ make pkgconf git tar xz gmp-dev re2-dev sqlite-dev fuse-dev ncurses-dev dash sqlite-static ncurses-static linux-headers jq postgresql
RUN apk add m4 g++ make pkgconf git tar xz gmp-dev re2-dev sqlite-dev fuse-dev ncurses-dev dash sqlite-static ncurses-static linux-headers jq

WORKDIR /build

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/dockerfiles/centos-7.6
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ FROM centos:7.6.1810
RUN yum -y update && yum clean all
RUN yum --setopt=skip_missing_names_on_install=False install -y rpm-build rpm-devel rpmlint make python bash coreutils diffutils patch rpmdevtools wget
RUN yum --setopt=skip_missing_names_on_install=False install -y epel-release
RUN yum --setopt=skip_missing_names_on_install=False install -y tar xz dash git which make gcc gcc-c++ fuse fuse-devel gmp-devel ncurses-devel sqlite-devel re2-devel squashfuse iproute jq postgresql
RUN yum --setopt=skip_missing_names_on_install=False install -y tar xz dash git which make gcc gcc-c++ fuse fuse-devel gmp-devel ncurses-devel sqlite-devel re2-devel squashfuse iproute jq
RUN yum --setopt=skip_missing_names_on_install=False install -y centos-release-scl
RUN yum --setopt=skip_missing_names_on_install=False install -y devtoolset-9-gcc*
RUN rpmdev-setuptree
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/dockerfiles/debian-bullseye
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM debian:bullseye

RUN apt-get update && apt-get install -y build-essential m4 devscripts git fuse libfuse-dev libgmp-dev libncurses5-dev libre2-dev libsqlite3-dev pkg-config squashfuse wget iproute2 jq postgresql
RUN apt-get update && apt-get install -y build-essential m4 devscripts git fuse libfuse-dev libgmp-dev libncurses5-dev libre2-dev libsqlite3-dev pkg-config squashfuse wget iproute2 jq


WORKDIR /build
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/dockerfiles/fedora-38
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ FROM fedora:38
RUN echo fastestmirror=1 >> /etc/dnf/dnf.conf
RUN dnf clean all
RUN dnf update -y
RUN dnf install -y rpm-build rpm-devel rpmlint make python39 bash diffutils patch rpmdevtools m4 tar xz dash git which make gcc gcc-c++ fuse fuse-devel gmp-devel ncurses-devel sqlite-devel re2-devel squashfuse wget iproute jq postgresql
RUN dnf install -y rpm-build rpm-devel rpmlint make python39 bash diffutils patch rpmdevtools m4 tar xz dash git which make gcc gcc-c++ fuse fuse-devel gmp-devel ncurses-devel sqlite-devel re2-devel squashfuse wget iproute jq
RUN rpmdev-setuptree


Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/dockerfiles/rocky-8
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ FROM rockylinux/rockylinux:8
RUN echo fastestmirror=1 >> /etc/dnf/dnf.conf
RUN dnf clean all
RUN dnf install -y epel-release
RUN dnf install -y rpm-build rpm-devel rpmlint make python36 bash diffutils patch rpmdevtools m4 tar xz dash git which make gcc gcc-c++ fuse fuse-devel gmp-devel ncurses-devel sqlite-devel re2-devel squashfuse wget iproute jq postgresql
RUN dnf install -y rpm-build rpm-devel rpmlint make python36 bash diffutils patch rpmdevtools m4 tar xz dash git which make gcc gcc-c++ fuse fuse-devel gmp-devel ncurses-devel sqlite-devel re2-devel squashfuse wget iproute jq
RUN rpmdev-setuptree


Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/dockerfiles/rocky-9
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ RUN echo fastestmirror=1 >> /etc/dnf/dnf.conf
RUN dnf clean all
RUN dnf install -y epel-release
RUN dnf --enablerepo=crb install -y fuse-devel
RUN dnf install -y rpm-build rpm-devel rpmlint make python3 bash diffutils patch rpmdevtools m4 tar xz dash git which make gcc gcc-c++ fuse gmp-devel ncurses-devel sqlite-devel re2-devel squashfuse dash wget iproute jq postgresql
RUN dnf install -y rpm-build rpm-devel rpmlint make python3 bash diffutils patch rpmdevtools m4 tar xz dash git which make gcc gcc-c++ fuse gmp-devel ncurses-devel sqlite-devel re2-devel squashfuse dash wget iproute jq

RUN rpmdev-setuptree

Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/dockerfiles/ubuntu-22.04
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
FROM ubuntu:22.04

RUN apt-get update && apt-get install -y build-essential m4 debhelper devscripts git fuse libfuse-dev libgmp-dev libncurses5-dev libre2-dev libsqlite3-dev pkg-config squashfuse wget iproute2 jq postgresql
RUN apt-get update && apt-get install -y build-essential m4 debhelper devscripts git fuse libfuse-dev libgmp-dev libncurses5-dev libre2-dev libsqlite3-dev pkg-config squashfuse wget iproute2 jq

WORKDIR /build
ENV VERSION=1.70.0
Expand Down
Loading