Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

vdb6 full database creation requires 32GB machine #203

Open
prabhu opened this issue Dec 30, 2024 · 1 comment
Open

vdb6 full database creation requires 32GB machine #203

prabhu opened this issue Dec 30, 2024 · 1 comment

Comments

@prabhu
Copy link
Contributor

prabhu commented Dec 30, 2024

Creating the full database including OS vulnerabilities currently requires a 32GB machine. We're relying on a self-hosted agent to create this database currently, but will be nice to get it working on a GitHub hosted agent at some point.

It is crashing during the index creation due to the DB size (> 7.5 GB)

db_lib.optimize_and_close_all()

@prabhu
Copy link
Contributor Author

prabhu commented Mar 8, 2025

This is creating some DevOps work for us. We have a couple of Mac Minis (M4) with 64GB RAM each. The plan was to create three 16GB VMs, each running a mix of macOS and Linux ARM64. However, the VDB job frequently kills the Linux ARM64 Lima instances during peak memory usage.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant