Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transparency around update cadence of data #21

Open
jasminewang0 opened this issue Jan 29, 2025 · 2 comments
Open

Transparency around update cadence of data #21

jasminewang0 opened this issue Jan 29, 2025 · 2 comments
Assignees

Comments

@jasminewang0
Copy link

It would be helpful for users to know how often package data is scheduled to be updated. I see that packages' "last synced" data ranges from <1 min ago to several months ago (ex. deprecated NPM package sntp). It is reasonable for deprecated packages to be synced less often, but I would love to have more information on:

  1. what cadence packages are synced on (I am assuming regularity is based on package usage?)
  2. when the next sync of a package will be

prior to taking dependencies.

Thank you!

@andrew andrew self-assigned this Jan 29, 2025
@andrew
Copy link
Member

andrew commented Jan 29, 2025

Thanks for reporting, deprecated npm packages not being synced is a bug, I’m not actively syncing packages marked as removed, deprecated packages probably got caught up in that as well, I’ll fix that tomorrow and resync all deprecated npm pkgs.

I’ll get to work on documenting the syncing approach right after FOSDEM as well.

Basically I try to sync the most popular packages every couple of days, every active package should be synced within 1 month, also syncing packages when new releases are detected in registries that have an api for listing recent packages, which are checked multiple times per day.

I’m also watching git repos for releases and tags and then check packages for new releases if and when the repos are updated.

@jasminewang0
Copy link
Author

Thanks Andrew! Could you link the syncing documentation when it's up?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants