Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Documentation request: Citus cluster migration #7672

Open
matikkane opened this issue Aug 21, 2024 · 0 comments
Open

Documentation request: Citus cluster migration #7672

matikkane opened this issue Aug 21, 2024 · 0 comments

Comments

@matikkane
Copy link

TLDR - I'd like to have documentation covering Citus cluster migration scenarios

Our background (the non-TLDR part) is covered in Citus Slack

To successfully migrate a complete Citus cluster the needed steps are somewhat clear:

  • deploy a new cluster
  • copy the data over and keep it in sync
  • switch over the clients to the new cluster

I believe it's possible to replicate a (current) Citus cluster into empty new Citus cluster (with same number of workers) using PUBLICATION + SUBSCRIPTION across each old and new workers, and across the old and new coordinators. By reading the documentation about CDC the idea is clear - just create pubs+subs not for ALL TABLES, but for the non-metadata user tables. But as we're replicating each worker and coordinators separately it's unclear if citus.enable_change_data_capture brings anything on the table (as we want to each target worker / shard to get 1:1 changes from the source)

It would be awesome if this kind of "migrate your Citus into new hardware" type of scenario would be covered in the documentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant