Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Animation Video S3 storage growth is unbounded #541

Open
Hamms opened this issue Dec 3, 2018 · 0 comments
Open

Animation Video S3 storage growth is unbounded #541

Hamms opened this issue Dec 3, 2018 · 0 comments
Labels
longterm Long term items that are out of scope.
Milestone

Comments

@Hamms
Copy link
Contributor

Hamms commented Dec 3, 2018

The S3 bucket where we are storing the rendered animations is currently at 130 gigabytes, and growing by a couple hundred megabytes a minute.

It's not particularly necessary for us to store these long-term; the standard workflow is for users to download the videos locally rather than viewing them online, and the videos can always be reconstructed from the logs. Post-HOC, it would probably be worthwhile to set up an automatic purge of videos older than 30 days, and also construct a video download workflow that can regenerate deleted videos.

Additionally, the bucket where we store the logs is at 55 gigabytes; the log format itself is significantly more verbose than it needs to be, and could either be refactored or run through jsonc to mitigate this.

@Hamms Hamms added the longterm Long term items that are out of scope. label Dec 3, 2018
@Hamms Hamms added this to the Post HOC milestone Dec 3, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
longterm Long term items that are out of scope.
Projects
None yet
Development

No branches or pull requests

1 participant