Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add an option to list all parquet files that have their metadata cached in object storage. #620

Open
Selfeer opened this issue Feb 12, 2025 · 1 comment

Comments

@Selfeer
Copy link

Selfeer commented Feb 12, 2025

Describe the new feature

We need a way to get a list of a parquet files that have their metadata cached in object storage via input_format_parquet_use_metadata_cache=1.

Use case

It is helpful for QA and general use as well to be able to determine weather the file that we are querying has it's metadata successfully cached or not and also to determine the files without cached metadata.

@Selfeer
Copy link
Author

Selfeer commented Feb 12, 2025

@arthurpassos

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant