Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

jsonPredicateHints is not working, getting complete result instead of filtered result #606

Closed
ShridharSangamkar opened this issue Nov 18, 2024 · 3 comments

Comments

@ShridharSangamkar
Copy link

ShridharSangamkar commented Nov 18, 2024

I am trying to use delta-share client to connect delta share and fetch the result. I am using delta-share latest version which I have installed using following

pip install --upgrade delta-share

the code snippet for fetching the data

predicate_json = json.dumps({
            "op": "equal",
            "children": [
                {"op": "column", "name": "memberid", "valueType": "integer"},
                {"op": "literal", "value": "123456", "valueType": "integer"},
            ],
        })
df = delta_sharing.load_as_pandas(url=table_url, jsonPredicateHints=predicate_json)
@walkeralexander
Copy link

Sorry, did you get this resolved?

@ShridharSangamkar
Copy link
Author

Yes that is resolved, the underlying table should be partitioned then only it will work, Also if it does not matches the condition then it will return complete result

@walkeralexander
Copy link

Gotcha, do you have any thoughts about the multi-condition jsonPredicateHint I was referring to? Totally fine if you haven't tried this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants