Skip to content

Latest commit

 

History

History
46 lines (31 loc) · 1.99 KB

RECOVERY.md

File metadata and controls

46 lines (31 loc) · 1.99 KB

Deployment and Content Maintenance and Recovery

Rolling back a failed code release and restoring a database has been tested and there is a strategy in place to provide the same assurances with content.

However there are a number of improvements that could still be made:

Recommendations

Ensure content restoration is possible whenever a coordinated code/content release is actioned.

  • Contentful does not provide the functionality, Launch to can only be used to publish.
  • If multiple entries need to be reverted or unpublished then a pre-launch clone of the environment must be made.
  • This places a restriction on teams of content editors to pause work until the success of the combined code and content release can be verified.
  • There are a limited number of environments in the current plan so only one restore point of the master can exist.

Synchronise the swap of web app and background worker and avoid deploying a worker when jobs are running.

  • The web server Azure AppService and background worker Azure Container share a database however migrations are only run within the AppService after a blue/green swap.
  • The worker will be recreated with new code before the web server can run any migrations it may require.
  • The deployment may interrupt active mail or data export jobs.

Mail jobs now have the capacity use MailEvents from Notify callbacks to remove users from the recipient scope ensuring that no duplicate messages are sent if the job is interrupted.

  • This is only implemented on the new module message but should be applied to all.
  • Mail messages can also be rescheduled outside of working hours.

Concurrent jobs are guarded against. v0.15.4 increases the export schedule from daily to every two days to ensure an active job has time to complete and prevent the the next day's export from auto-expiring.

Increase the database server fast restore points in Azure to more than once in 24hrs

  • Additional cost may be incurred