Skip to content

v1.9.0
Compare
Choose a tag to compare
@mjakubowski84 mjakubowski84 released this 26 Apr 11:54
· 217 commits to master since this release
v1.9.0
29d9b03

Many changes in this version. It slowly builds foundation for version 2.x in which you may expect many changes internally and in API.

Parquet schema migrated to version 1.11+

  • Parquet4S no longer uses deprecated schema types internally.
  • Definition of custom types using old types is deprecated in favour for new types.
  • Simplified API of defining custom types is introduced - check the README and examples.
  • Deprecated API got slightly modified but is supposed to be backwards compatible. Some that use it very extensively may encounter small compilation issues after upgrade.
  • Please migrate to new API as it is going to be removed in 2.x version.

Revamped Filtering

  • Ability to filter by UDP - user defined predicate - write your own filter predicate!
  • Simplified rewritten internal API.
  • Old API was mostly private so no backward incompatibility is expected for most of users.
  • New Filter API is public so you can define filters for your own custom types now, too. Just implement FilterCodec[T] for your type T.
  • Allowed to filter by Array[Byte]
  • In predicate in version with multiarg got modified so it expect now at least single parameter - that enforces proper usage of it at compilation time.

Bufixes

  • FS2's viaParquet was processing partitionBy parameters improperly. In effect, one could not partition by non-root field. It is fixed now.
Assets 2
Loading