Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spike: Identify What Must Change to Leverage Pre-Processing of the Rodeo #406

Closed
1 of 3 tasks
Tracked by #421
jeremyf opened this issue Apr 13, 2023 · 0 comments
Closed
1 of 3 tasks
Tracked by #421
Assignees

Comments

@jeremyf
Copy link
Contributor

jeremyf commented Apr 13, 2023

The goal of this spike is to review the Derivative Rodeo, Bulkrax Implementation, Adventist Overrides, and IIIF Print to establish an approach on leveraging the pre-processed files instead of running the pre-processing inline.

From this spike will flow a set of tasks to complete the integration of the Derivative Rodeo pre-processing with the ingest process for Adventist.

Use Cases and Questions

Given that the Derivative::Rodeo will have downloaded the <original file>
And that the Derivative::Rodeo has pre-processed the derivatives
When I am using Bulkrax to import a record with a remote <original file>
Then I need to instead use the <original file> now in the Derivative::Rodeo

Questions:

  • How could Bulkrax know that the <original file> is in the Derivative::Rodeo?
  • What are our options for treating the Derivative::Rodeo files as mounted storage?
  • Particularly in S3, what would it mean to move the file from the Derivative::Rodeo to a Fedora aware location?
    • What affordances do we have in that data transfer?

Tasks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant