Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add option for IDS to be tolerant of restore failures #119

Open
kevinphippsstfc opened this issue Mar 26, 2021 · 0 comments · May be fixed by #120
Open

Add option for IDS to be tolerant of restore failures #119

kevinphippsstfc opened this issue Mar 26, 2021 · 0 comments · May be fixed by #120
Assignees
Milestone

Comments

@kevinphippsstfc
Copy link
Contributor

This is an issue experienced by both Diamond and ESRF where in both cases it is known that there are entries in ICAT which do not have corresponding files available on the tape archive system. Currently the IDS is very strict and will not allow a retrieval to continue if it finds that there are any files that are not available from the archive storage.

For both Diamond and ESRF the IDS is only used in read only mode (only for restores - no deleting or writing) so it is safer to ignore the restore failures than for an IDS that also does write operations.

What is envisaged is an optional property in the run.properties file that if set to true, causes the IDS to be more tolerant of failures and only to fail if all of the items requested by the user are unavailable. The default behaviour would be for the IDS to continue to behave as it does currently.

In cases where there are failures, a list of the failures will be written to a file that is inserted into the downloaded zip file, with the name and location of this file being configurable via another property.

@kevinphippsstfc kevinphippsstfc self-assigned this Mar 26, 2021
@kevinphippsstfc kevinphippsstfc linked a pull request Mar 26, 2021 that will close this issue
@RKrahl RKrahl added this to the 2.0.0 milestone Mar 31, 2021
@RKrahl RKrahl modified the milestones: 2.0.0, 3.0.0 Jul 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants