Delta to Iceberg Conversion Error - org.apache.xtable.exception.ReadException: Failed to iterate through Delta data files

[surajsubramani22]

Facing the below issue. Any suggestions on what I might have missed?

Config File:

Sample Delta Table on S3 reads okay.

Followed the steps as detailed here -> https://xtable.apache.org/docs/how-to/#create-dataset

[the-other-tim-brown]

@surajsubramani22 it looks like the stats on the files are null within the delta commit. Is it possible the stats were not added as part of the commit?

[surajsubramani22]

Thanks @the-other-tim-brown , Are you referring to this? I’m able to see the below contents in the file and able to read the delta table fine.

[the-other-tim-brown]

Yes, that is what I was referring to. I think we need a fix in the code to account for this case. Are you interested in submitting a patch?

[surajsubramani22]

Makes sense. Tested with a delta stats file and it worked fine. With regards to a fix for the bug, It will probably take me a while to get to it unfortunately.

[the-other-tim-brown]

I have created this issue for tracking and will put up a fix shortly #481

[the-other-tim-brown]

Here is the PR: #482