New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support dynamic fields partitioned without requiring Avro scheme #274

Open

liorluker opened this issue Feb 7, 2023 · 0 comments

Labels

S3

liorluker commented Feb 7, 2023

Currently, the partitioning capbilities in Aiven are very limited and doesn't enable dynamic partition like AWS firehose support https://aws.amazon.com/blogs/big-data/kinesis-data-firehose-now-supports-dynamic-partitioning-to-amazon-s3/.
I guess it could also support as third implementation like similar to https://github.com/canelmas/kafka-connect-field-and-time-partitioner

jjaakola-aiven added the S3 label

ahmedsobeh transferred this issue from Aiven-Open/s3-connector-for-apache-kafka

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment