Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a step to create an evenly-spaced version of categorical values #58

Open
wants to merge 1 commit into
base: develop
Choose a base branch
from

Conversation

katmatson
Copy link

Add a 'categorical_values' option to the config that will create alternate versions of the specified columns that have evenly-spaced values instead of the categorical values in the original column. For each property that represents a categorical value, this option must include all of the possible values and provide an order that the values should be sorted into.

For example, the permafrost and ground ice dataset includes a categorical EXTENT property that can have one of four values, represented by their first letter: Continuous, Discontinuous, Sporadic, Isolated patches. Adding the following 'categorical_values' option to the config will result in a new column (named staged_normalized_EXTENT) mapping those values to 4, 3, 2, and 1 respectively:

"categorical_values": {
  "EXTENT": ['I', 'S', 'D', 'C'],
},

So long as the list of all possible values for the column is known and specified, this should work for categorical properties of any data type, so it resolves #48.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

Successfully merging this pull request may close these issues.

Automate adding an evenly-spaced numerical code for categorical datasets
1 participant