Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Conversion of dates from MySQL to Parquet cannot handle dates before 1970-01-01 #3092

Open
berthelemy opened this issue Feb 12, 2025 · 0 comments
Labels
bug Something isn't working to-review Evidence team to review

Comments

@berthelemy
Copy link

Describe the bug

Dates from MySQL that are before 1970-01-01 are placed into Parquet as NULL.

See Slack conversation at: https://evidencedev.slack.com/archives/C023LRB9Z40/p1739367984957319

Steps to Reproduce

Create a MySQL database with a longtext field containing a Unixtime date from before 1970-01-01. In MySQL this is stored as a negative number, eg. -27910800 for 12 February 1969 (UTC+1)

Set this database as an Evidence source.

Review the data in the Parquet files.

Expected behaviour: The date should be stored as a negative number in the Parquet file.
Actual behaviour: The date is set to Null

Reference

https://www.epochconverter.com/ - to test conversion between unixtime and human time

Logs

System Info

Severity

serious, but I can work around it

Additional Information, or Workarounds

The only way I can work around this is to leave out the Date of Birth data I was hoping to use in my charts.

@berthelemy berthelemy added bug Something isn't working to-review Evidence team to review labels Feb 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working to-review Evidence team to review
Projects
None yet
Development

No branches or pull requests

1 participant