Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: k8s deployment files #7416

Merged
merged 72 commits into from
May 16, 2024
Merged

ci: k8s deployment files #7416

merged 72 commits into from
May 16, 2024

Conversation

NGPixel
Copy link
Member

@NGPixel NGPixel commented May 14, 2024

No description provided.

jennifer-richards and others added 30 commits May 13, 2024 21:41
* feat: merge dt and celery container builds

* fix: mount /a instead of /assets

* feat: use consolidated script

* fix: get start.sh dependencies. Remove watchdog

* fix: correct source path
* style: CRLF -> LF

* build: Use AppVersion for image

* chore: Helm YAML indent_size = 2

* ci: Deploy settings_local.py via helm

* ci: misc progress on the helm chart (WIP)

* ci: move configmap to env in values.yaml

* ci: Refactor env and configmap formats

* ci: merge fixup + helm debugging

* ci: Fix rabbitmq.yaml and its values

* ci: fix up other deployments

* ci: fix copy error in beat.yaml and celery.yaml

* ci: install correct images and volumes
* ci: service.yaml -> services/datatracker.yaml

* ci: memcached service

* ci: simplify memcached service name

* ci: Use correct service.type for memcached
* ci: use datatracker image values for celery/beat

* ci: refactor exec command lists as JSON

---------

Co-authored-by: Robert Sparks <[email protected]>
* ci: rabbitmq service (wip)

* ci: customize rabbitmq config
* ci: give rabbitmq a persistent volume claim

This relies on minikube's dynamic creation of
persistent volumes - expect changes likely
needed for production deployment.

* ci: that's not an f-string

* ci: todo is todone
* feat: use gunicorn

* fix: let gunicorn emit logs to stdout/stderr

* fix: log to stdout/stderr in json format

* fix: run collectstatic for the local copy of the statics
Use bullseye-backports to get something more recent
(ietfa has 7.3.6.2; bullseye has 7.0.x.x;
bullseye-backports has 7.4.7.2)
* ci: parameterize gunicorn in datatracker-start.sh

* fix: typo

* ci: update settings_local for helm chart

* ci: Add todo comment

* ci: Drop redundant USE_TZ setting

* ci: Require secrets in production

* ci: fix indentation

* style: Black

* ci: memcached cfg from env in settings.py

* ci: set SITE_URL in settings.py

* refactor: /www/htpasswd -> /a/www/htpasswd

(it's a symlink on production)

* refactor: Remove obsolete SECR_ settings

* refactor: SECR_MAX_UPLOAD_SIZE -> DATATRACKER_...

* refactor: SECR_PPT2PDF_COMMAND -> PPT2PDF_COMMAND

* ci: Fix up helm/settings_local

* ci: Remove commented-out settings

* ci: Refactor/improve env var guards

* ci: More env refactoring / guards
* ci: Get APP_API_TOKENS from env

* ci: chart fixup

* ci: Remove canned APP_API_TOKENs

(setec astronomy)
* ci: shared PersistentVolumeClaim on /a

* ci: Increase storage request, add comment
* ci: Require secrets, even in "development"

* ci: More secrets-requiring

* ci: Strip whitespace out before b64 decoding

* ci: Adjust values.yaml

* ci: Comment in values.yaml
* ci: Remove unused service values

* ci: Reorg labels
* ci: Expose PV parameters as values

* ci: complain about missing value in dev mode

* ci: Allow override of STATIC_URL
jennifer-richards and others added 6 commits May 13, 2024 21:41
b64decode defaults to validate=false, which discards chars
outside the base64 alphabet. That includes whitespace.
* chore: remove update_external_command_info call

* feat: get tool version without VersionInfo

* chore: Remove VersionInfo model

* chore: Migration to remove VersionInfo

* fix: handle errors better; ignore stderr
@NGPixel NGPixel marked this pull request as ready for review May 14, 2024 01:43
@NGPixel NGPixel changed the title k8s deployment files ci: k8s deployment files May 14, 2024
System-level integration like this really needs
to be in settings_local. This was causing problems
when running in the dev environment.
@rjsparks
Copy link
Member

Acknowledging that we ended up destroying the github verification of some of the commits along the way, but are merging anyhow after careful review.

@rjsparks rjsparks merged commit de8b3b5 into main May 16, 2024
7 checks passed
@github-actions github-actions bot locked as resolved and limited conversation to collaborators May 22, 2024
@rjsparks rjsparks deleted the feat/k8s branch August 9, 2024 14:19
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants