Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add --continue_upload flag #466

Open
wants to merge 5 commits into
base: develop
Choose a base branch
from
Open

Add --continue_upload flag #466

wants to merge 5 commits into from

Conversation

rajeee
Copy link
Contributor

@rajeee rajeee commented Aug 14, 2024

Pull Request Description

Add --continue_upload flag so that if files are partially uploaded to s3, one can continue from that.

Verified operation by deleting some files from s3 and letting BSQ initialization flag it.
image

Then I ran --continue_upload to get the missing files uploaded.
image

The error is then resolved.
image

--upload_only will still error out and suggest using --continue_upload.

image

Checklist

Not all may apply

  • Code changes (must work)
  • Tests exercising your feature/bug fix (check coverage report on Checks -> BuildStockBatch Tests -> Artifacts)
  • Coverage has increased or at least not decreased. Update minimum_coverage in .github/workflows/coverage.yml as necessary.
  • All other unit and integration tests passing
  • Update validation for project config yaml file changes
  • Update existing documentation
  • Run a small batch run on Kestrel/Eagle to make sure it all works if you made changes that will affect Kestrel/Eagle
  • Add to the changelog_dev.rst file and propose migration text in the pull request

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant