Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add option for automatically updating medic-sentinel/_local/transitions-seq after inserting data #23

Open
jkuester opened this issue Sep 27, 2024 · 0 comments

Comments

@jkuester
Copy link
Collaborator

When generating large datasets, it is pretty easy to overwhelm Sentinel with the amount of docs to process. In my experience running locally, with just 500K docs generated into the medic db, the Couch indexing finishes hours before Sentinel catches up. It is not so much that Sentinel is taking too long to run transitions, but really that it is having a hard time even processing the sheer number of new docs.

We should consider possibly adding an option to automatically update the medic-sentinel/_local/transitions-seq value when we are done generating the data. If we set this to the latest changes sequence, then I think that Sentinel will just automatically skip all the inserted docs.

Probably should not have this be the default behavior, though, since in some cases you might want to actually run Sentinel transitions on the new docs...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant