Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow skipping specific checks in extra-data-validate #522

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

takluyver
Copy link
Member

This is a partial response to #503.

The idea is that extra-data-validate is made up of a series of named checks, and you can pass e.g. --skip control_timestamps_order to skip the check with that name. So far only the per-file checks can be controlled like this, but if we like the structure, we could add the per-directory checks (so far only one, checking the JSON cache).

Specifically, the @file_check decorator makes a function into a named check. The function name is reused as the check name (so we'll need to remember not to rename these functions too readily).

f'{pos + 1} ({ts[pos + 1]} < {ts[pos]})',
dataset=ds_path,
)
for src, group in src_groups:

Check notice

Code scanning / CodeQL

Nested loops with same variable Note

Nested for statement uses loop variable 'src' of enclosing
for statement
.
@steffenhauf
Copy link
Member

Thanks, I like this approach, as it allows a good level of granularity depending on the context the checks are run in.

@philsmt
Copy link
Contributor

philsmt commented Jun 3, 2024

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants