Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

S3 source connector + Parquet #403

Merged
merged 3 commits into from
Nov 21, 2023
Merged

Conversation

jacksonrnewhouse
Copy link
Contributor

This takes #327 and adds on Parquet support. Doing this directly instead of rcjmurillo#1 so we can get it into the next release.

arroyo-connectors/src/filesystem.rs Outdated Show resolved Hide resolved
@mwylde
Copy link
Member

mwylde commented Nov 14, 2023

We'll want to either figure out the issues with the web creation of file sources/sinks (maybe @jbeisen can help here?) or disable it

@rcjmurillo
Copy link
Contributor

thank you for following up the work, will close #327.

Remove some unnecessary nesting in the file system table schema,
standardize the field capitalization, and add a MapWidget component to
support a Storage Options string map. Also renders all helper text in
the JsonForm as markdown so it can include links.
@jacksonrnewhouse jacksonrnewhouse merged commit e21c079 into master Nov 21, 2023
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants