Tools for organizing backfilling activity
- generate and batch sql file from a csv
- auto backup to csv before each execution
- run your sql automatically
- prepare your csv, the structure have to contains the fields that will be updated, and an "id" column
- run this command to generate the sql(s)
go run . gen --source <path to your csv> -t <table name> --size <batch size> --output <output dir>- run this command to execute the backfill
go run . run --url postgres://<username>:<password>@<your_url>:<port>/<dbname> --source <output dir from prev step>- Concurrent Execution
- generate create (or maybe upsert) query mode