New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add fake credit card data from scoofy example data into the glue job #25

Open

jankatins opened this issue Nov 4, 2022 · 0 comments

Labels

good first issue

Contributor

jankatins commented Nov 4, 2022

We added PII data so we can show how that is soposed to be handled. This is in the raw data, but not selecting it when doing the parquet conversion.

Tasks:

Figure out a hash functions for glue (ask @jankatins, he has some examples ...)
Add it to the glue job which transforms the scoofy data
Push the hash through in dbt?

DoD:

hashed data is available in at least one the final dataset (e.g. latest credit card hash)

jankatins added the good first issue label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment