Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GPL-926 Housekeeping - training environment link to warehouses (E:L, V:3) #127

Closed
KatyTaylor opened this issue Mar 23, 2021 · 1 comment
Closed

Comments

@KatyTaylor
Copy link

KatyTaylor commented Mar 23, 2021

Describe the Housekeeping
The Sequencescape training environment should link to the Multi-LIMS and Event warehouses. We use training as an environment in which to test data fixes, because it has a copy of production data. It would be a more useful and thorough test setup if the effect of those data fixes could be seen on the warehouses.

The warehouse consumers should be linked to databases that contain regularly refreshed production data - perhaps mlwhd_mlwh_events_proddata and mlwhd_mlwarehouse_proddata.
Be aware that Sequencescape UAT currently sends messages to mlwhd_mlwh_events_proddata - there is an issue to change this here - sanger/event_warehouse#117

Additional context
This came out of the UKB data fixes - #120 - as something that would make it quicker next time.
The workaround used for that was to set up a RabbitMQ server and the Sequencescape / MLWH / Events WH consumers locally, pointing to the sequencescape_snapshot and mlwhd_mlwh_events_proddata databases, which took 3 full days, and ran very slowly.

@rl15 rl15 changed the title Housekeeping - training environment link to warehouses GPL-926 Housekeeping - training environment link to warehouses Mar 23, 2021
@KatyTaylor KatyTaylor changed the title GPL-926 Housekeeping - training environment link to warehouses GPL-926 Housekeeping - training environment link to warehouses (L) Mar 24, 2021
@stevieing stevieing changed the title GPL-926 Housekeeping - training environment link to warehouses (L) GPL-926 Housekeeping - training environment link to warehouses (E:L, V:3) Jun 16, 2021
@TWJW-SANGER
Copy link

Appears to be a duplicate of #336

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants