Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: update apiv2 db ingestion to support new s3 schema #324

Open
wants to merge 26 commits into
base: main
Choose a base branch
from

Conversation

jgadling
Copy link
Contributor

This PR is currently in a DRAFT state because I haven't updated the tests to reflect the latest changes, however the importer should be complete and working.

Some changes to note:

  • Annotation importers were refactored to use the new importer base classes because that made it easier to update them to support ingesting a single annotation across multiple voxel spacings
  • The Tomogram importer was refactored as well, just to help this migration along.

I've update the test data to look more like real-world data, with zarr files and other extras, basically because it made running the s3 conversion script on our existing test data easier. These files are a little bit out of date as well since they still reflect old file path formats, but I'll update them soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant