Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Production Deploy #3457

Merged
merged 103 commits into from
Nov 9, 2023
Merged

Production Deploy #3457

merged 103 commits into from
Nov 9, 2023

Conversation

davidsmejia
Copy link
Contributor

@davidsmejia davidsmejia commented Nov 9, 2023

Production Deploy v1.46.22

Changelog

  • Integrates 1 Password for secrets management
  • Moves away from RAVEN_DSN naming to SENTRY_DSN
  • Unifies bug tracking by using environment in Sentry configuration
  • Updates secrets naming for improved readability
  • Splits NOOP and Downloader tests
  • removes tracking of dev tfvars
  • improvements to slack updates summary
  • renames harmonized value genotype to genetic_information
  • persists harmonized value developmental_stage
  • adds new mappings for supported airway pathogens via Add new airway pathogens to organism-strain mapping file #3366
  • adds species taxon id to mapping config file to handle ambiguity when processing a division
  • adds tracking data request command for reporting on data processing requests
  • scales up worker storage to from 500GB to 1TB
  • transcriptome indexes download protocol from ftp to http
  • implements heredoc syntax for dockerfiles
  • moves api static files from /tmp to /var
  • and other housekeeping changes

arkid15r and others added 30 commits September 12, 2023 08:51
Place compendia test data to data-refinery-test-assets bucket
Move microarray.txt and rnaseq.txt under workers/tests/data
Sort microarray.txt and rnaseq.txt URLs
Don't include 0 downloads users into stats calculation
Use GH workflow badge for refine.bio status
Add a command that gathers/shows stats based on a accession code list.
The areas of interest include attempted/available experiments
(total and broken down by source) as well as attempted/available samples
(total and broken down by source).
The total number of jobs created includes all job types.
Export SYSTEM_VERSION when unset
Set platform for `run_management_command.sh`
It's mostly done to speed up the prod (different docker registry)
build process.
…-for-prod-image-builds

Extend using of staging images cache
  - Unify secret names
  - Move SSH_PUBLIC_KEY to vars
  - Set GH env secrets in necessary scopes only
  - Add environment and release version into Sentry context
Update downloaders image aspera path.
arkid15r and others added 26 commits October 20, 2023 11:08
  - Bump certifi version
  - Remove unused coveralls dependency
…op-test-jobs

Split downloaders/no_op test jobs
…ntal-stage

Add Sample::developmental_stage field support
…start

Add API server SSH connection check
  - Remove 30d+ old Docker images.
  - Use wget instead of curl for gene index downloads
  - Set specific unzip/rm file instructions
  - Set pre-commit to use Python 3.11
…tart-flag

Add restart flag to API docker container
…estart

Map static dir on API to /var/www/volumes_static on deploy
Co-authored-by: Arkadii Yakovets <[email protected]>
…pi-static-dir

3452 Ensure /var/www/volumes_static exists on container restart
@davidsmejia davidsmejia requested a review from arkid15r November 9, 2023 18:25
@davidsmejia davidsmejia marked this pull request as ready for review November 9, 2023 19:14
Copy link
Contributor

@arkid15r arkid15r left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 🚀

🤞

@davidsmejia davidsmejia merged commit 50ac1f4 into master Nov 9, 2023
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants