Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore(deps): update rust crate arrow to v53 #65

Merged
merged 1 commit into from
Sep 7, 2024
Merged

chore(deps): update rust crate arrow to v53 #65

merged 1 commit into from
Sep 7, 2024

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 3, 2024

This PR contains the following updates:

Package Type Update Change
arrow dev-dependencies major 52 -> 53
arrow dependencies major 52 -> 53

Release Notes

apache/arrow-rs (arrow)

v53.0.0

Compare Source

Full Changelog

Breaking changes:

Implemented enhancements:

  • Derive PartialEq and Eq for parquet::arrow::ProjectionMask #​6329 [parquet]
  • Allow converting empty pyarrow.RecordBatch to arrow::RecordBatch #​6318 [arrow]
  • Parquet writer should not write any min/max data to ColumnIndex when all values are null #​6315 [parquet]
  • Parquet: Add union method to RowSelection #​6307 [parquet]
  • Support writing UTC adjusted time arrow array to parquet #​6277 [parquet]
  • A better way to resize the buffer for the snappy encode/decode #​6276 [parquet]
  • parquet_derive: support reading selected columns from parquet file #​6268
  • Tests for invalid parquet files #​6261 [parquet]
  • Implement date_part for Duration #​6245 [arrow]
  • Avoid unnecessary null buffer construction when converting arrays to a different type #​6243 [parquet] [arrow]
  • Add parquet_opendal in related projects #​6235
  • Look into optimizing reading FixedSizeBinary arrays from parquet #​6219 [parquet] [arrow]
  • Add benchmarks for BYTE_STREAM_SPLIT encoded Parquet FIXED_LEN_BYTE_ARRAY data #​6203 [parquet]
  • Make it easy to write parquet to object_store -- Implement AsyncFileWriter for a type that implements obj_store::MultipartUpload for AsyncArrowWriter #​6200 [parquet]
  • Remove test duplication in parquet statistics tets #​6185 [parquet]
  • Support BinaryView Types in C Schema FFI #​6170 [arrow]
  • speedup take_byte_view kernel #​6167 [arrow]
  • Add support for StringView and BinaryView statistics in StatisticsConverter #​6164 [parquet]
  • Support casting BinaryView --> Utf8 and LargeUtf8 #​6162 [arrow]
  • Implement filter kernel specially for FixedSizeByteArray #​6153 [arrow]
  • Use LevelHistogram throughout Parquet metadata #​6134 [parquet]
  • Support DoPutStatementIngest from Arrow Flight SQL 17.0 #​6124 [arrow] [arrow-flight]
  • ColumnMetaData should no longer be written inline with data #​6115 [parquet]
  • Implement date_part for Interval #​6113 [arrow]
  • Implement Into<Arc<dyn Array>> for ArrayData #​6104
  • Allow flushing or non-buffered writes from arrow::ipc::writer::StreamWriter #​6099 [arrow]
  • Default block_size for StringViewArray #​6094 [arrow]
  • Remove Statistics::has_min_max_set and ValueStatistics::has_min_max_set and use Option instead #​6093 [parquet]
  • Upgrade arrow-flight to tonic 0.12 #​6072
  • Improve speed of row converter by skipping utf8 checks #​6058 [arrow]
  • Extend support for BYTE_STREAM_SPLIT to FIXED_LEN_BYTE_ARRAY, INT32, and INT64 primitive types #​6048 [parquet]
  • Release arrow-rs / parquet minor version 52.2.0 (August 2024) #​5998 [parquet] [arrow]

Fixed bugs:

  • Invalid ColumnIndex written in parquet #​6310 [parquet]
  • comparison_kernels benchmarks panic #​6283 [arrow]
  • Printing schema metadata includes possibly incorrect compression level #​6270 [parquet]
  • Don't panic when creating Field from FFI_ArrowSchema with no name #​6251 [arrow]
  • lexsort_to_indices should not fallback to non-lexical sort if the datatype is not supported #​6226 [arrow]
  • Parquet Statistics null_count does not distinguish between 0 and not specified #​6215 [parquet]
  • Using a take kernel on a dense union can result in reaching "unreachable" code #​6206 [arrow]
  • Adding sub day seconds to Date64 is ignored. #​6198 [arrow]
  • mismatch between parquet type is_optional codes and comment #​6191 [parquet]

Documentation updates:

Closed issues:

Merged pull requests:

* This Changelog was automatically generated by github_changelog_generator

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about these updates again.

  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@abdolence abdolence merged commit 468f5a3 into master Sep 7, 2024
3 checks passed
@abdolence abdolence deleted the renovate/arrow-53.x branch September 7, 2024 10:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@abdolence abdolence abdolence approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@abdolence