Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Documentation] Update documentation for S3 sink #3252

Closed
dlvenable opened this issue Aug 25, 2023 · 2 comments
Closed

[Documentation] Update documentation for S3 sink #3252

dlvenable opened this issue Aug 25, 2023 · 2 comments
Assignees
@dlvenable
Labels
documentation Improvements or additions to documentation
Milestone
v2.4

Comments

@dlvenable
Copy link
Member

We've made a few changes to the S3 sink behavior that need to be documented.

  • The Parquet/Avro schemas now take precedence over include/exclude.
  • Changes to the Parquet codec - it must use in_memory buffer.

Additionally, the following can help users:

  • More details on auto-schema generation
  • Recommendations for schemas: nullable
@dlvenable dlvenable added documentation Improvements or additions to documentation and removed untriaged labels Aug 25, 2023
@dlvenable dlvenable added this to the v2.4 milestone Aug 25, 2023
@dlvenable dlvenable mentioned this issue Aug 25, 2023
Merged
1 task
@dlvenable dlvenable self-assigned this Aug 25, 2023
@dlvenable
Copy link
Member Author

I opened a PR on the documentation website:

opensearch-project/documentation-website#4897

@dlvenable
Copy link
Member Author

The above PR was approved and merged.

@github-project-automation github-project-automation bot moved this from Unplanned to Done in Data Prepper Tracking Board Aug 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dlvenable dlvenable

Labels
documentation Improvements or additions to documentation
Projects
Data Prepper Tracking Board
Archived in project
Milestone
v2.4
Development

No branches or pull requests
1 participant
@dlvenable