Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgraded pidgtm compile, added persistent error logs, and created some automation #58

Merged
merged 6 commits into from
Dec 30, 2023

Conversation

danbugs
Copy link
Owner

@danbugs danbugs commented Dec 30, 2023

Changelog:

  • Updated every dependency to their latest versions.
  • Deleted Deployment-*.yml files, I'm creating every job/deployment through shell scripts now.
  • Created IdGeneration.py file to generate id_ranges (later to be compiled in id_ranges.txt) to create jobs/deployments. This is different from the prior SQL query, because it doesn't consider what we have in the DB, just assigns equal splitting from 1000-X id (provided by CLI).
  • Created error_logs table to store error logs, and retired last_cached_player_ids - which is now being reused as pidgtm_compile_times to allow me to calculate a running average on how long it takes to compile player data.
  • Created shell script to auto create multiple deployments for pidgtm map.
  • If we have something like a parsing error (or any 'oddities'), we now delete all of that player's data (i.e., games, sets, tournaments) from the db to avoid false positives.
  • Removed pidgtm update, map now does both.
  • pidgtm compile now aggregates player data, but also updates/maps.

Signed-off-by: danbugs <[email protected]>

typo

Signed-off-by: danbugs <[email protected]>
@danbugs danbugs added management management related work (e.g., docs, and whatnot) feature new feature refactor changing an existing feature labels Dec 30, 2023
Signed-off-by: danbugs <[email protected]>
@danbugs danbugs changed the title Upgraded pidgtm compile, persistent error logs, and some automation Upgraded pidgtm compile, added persistent error logs, and created some automation Dec 30, 2023
Signed-off-by: danbugs <[email protected]>
Signed-off-by: danbugs <[email protected]>
Signed-off-by: danbugs <[email protected]>
@danbugs danbugs merged commit b242f1e into main Dec 30, 2023
6 checks passed
@danbugs danbugs deleted the danbugs/compile-upgrade-2 branch December 30, 2023 01:08
@danbugs danbugs added this to the MVP milestone Jan 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature new feature management management related work (e.g., docs, and whatnot) refactor changing an existing feature
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant