v0.22.1

0.22.1 (2022-07-19)

Bug Fixes

• Change numpy version on setup.py and upgrade it to resolve dependabot warning (#2887) (b9190b9)
• Change the feature store plan method to public modifier (#2904) (568058a)
• Deprecate 3.7 wheels and fix verification workflow (#2934) (146e36d)
• Fix build wheels workflow to install apache-arrow correctly (#2932) (4b69e0e)
• Fix grpc and update protobuf (#2894) (f726c96)
• Fix night ci syntax error and update readme (#2935) (b35553b)
• Fix nightly ci again (#2939) (c363619)
• Fix the go build and use CgoArrowAllocator to prevent incorrect garbage collection (#2919) (f4f4894)
• Fixing broken links to feast documentation on java readme and contribution (#2892) (a45e10a)
• Resolve small typo in README file (#2930) (9840c1b)
• Update gopy to point to fork to resolve github annotation errors. (#2940) (9b9fbbe)

v0.22.0

0.22.0 (2022-06-29)

Overview

This release adds many bug fixes, as well as some new functionality to help with realtime use cases:

• SQLAlchemy backed registry (as an alternative to a file registry) (documentation)
• A universal push API so users can push (streaming) feature values to both offline / online stores (documentation)
• [Alpha] High level objects to define stream transformations. There are contrib components to help pull registered stream transformations, execute them, and push transformed feature values to the online store. (tutorial)
• [Alpha] Logging served feature values (from the Go feature server) to the offline store and validating against Great Expectations suite using feast validate (tutorial)

Features

• Add feast repo-upgrade for automated repo upgrades (#2733) (a3304d4)
• Add file write_to_offline_store functionality (#2808) (c0e2ad7)
• Add http endpoint to the Go feature server (#2658) (3347a57)
• Add simple TLS support in Go RedisOnlineStore (#2860) (521488d)
• Add StreamProcessor and SparkKafkaProcessor as contrib (#2777) (83ab682)
• Added Spark support for Delta and Avro (#2757) (7d16516)
• CLI interface for validation of logged features (#2718) (c8b11b3)
• Enable stream feature view materialization (#2798) (a06700d)
• Enable stream feature view materialization (#2807) (7d57724)
• Implement offline_write_batch for BigQuery and Snowflake (#2840) (97444e4)
• Offline push endpoint for pushing to offline stores (#2837) (a88cd30)
• Push to Redshift batch source offline store directly (#2819) (5748a8b)
• Scaffold for unified push api (#2796) (1bd0930)
• SQLAlchemy Registry Support (#2734) (b3fe39c)
• Stream Feature View FCOS (#2750) (0cf3c92)
• Update stream fcos to have watermark and sliding interval (#2765) (3256952)
• Validating logged features via Python SDK (#2640) (2874fc5)

Bug Fixes

• Add columns for user metadata in the tables (#2760) (269055e)
• Add project columns in the SQL Registry (#2784) (336fdd1)
• Add S3FS dependency (which Dask depends on for S3 files) (#2701) (5d6fa94)
• Bugfixes for how registry is loaded (#2768) (ecb8b2a)
• Conversion of null timestamp from proto to python (#2814) (cb23648)
• Correct feature statuses during feature logging test (#2709) (cebf609)
• Correctly generate projects-list.json when calling feast ui and using postgres as a source (#2845) (bee8076)
• Dynamodb drops missing entities when batching (#2802) (a2e9209)
• Enable faulthandler and disable flaky tests (#2815) (4934d84)
• Explicitly translate errors when instantiating the go fs (#2842) (7a2c4cd)
• Fix broken roadmap links (#2690) (b3ba8aa)
• Fix bugs in applying stream feature view and retrieving online features (#2754) (d024e5e)
• Fix Feast UI failure with new way of specifying entities (#2773) (0d1ac01)
• Fix feature view getitem for feature services (#2769) (88cc47d)
• Fix issue when user specifies a port for feast ui (#2692) (1c621fe)
• Fix macos wheel version for 310 and also checkout edited go files (#2890) (bdf170f)
• Fix on demand feature view crash from inference when it uses df.apply (#2713) (c5539fd)
• Fix SparkKafkaProcessor query_timeout parameter (#2789) (a8d282d)
• Fix workflow syntax error (#2869) (fae45a1)
• Fixed custom S3 endpoint read fail (#2786) (6fec431)
• Go install gopy instead using go mod tidy (#2863) (2f2b519)
• Hydrate infra object in the sql registry proto() method (#2782) (452dcd3)
• Implement apply_materialization and infra methods in sql registry (#2775) (4ed107c)
• Minor refactor to format exception message (#2764) (da763c6)
• Prefer installing gopy from feast's fork as opposed to upstream (#2839) (34c997d)
• Python server is not correctly starting in integration tests (#2706) ([7583a0b](7583a0b...

v0.21.3

0.21.3 (2022-06-13)

Bug Fixes

• Change online UI schema field to be optional (#2766) (e6edb58), closes #2719
• Made URL to registry relative, fixes #2731 (#2753) (a66aea8)

v0.21.2

0.21.2 (2022-05-17)

Bug Fixes

• Correct feature statuses during feature logging test (#2709) (c529d58)
• Fix on demand feature view crash from inference when it uses df.apply (#2713) (0f6da6c)
• Random port allocation for python server in tests (#2710) (e714b16)

v0.21.1

0.21.1 (2022-05-16)

Bug Fixes

• Add S3FS dependency (which Dask depends on for S3 files) (#2701) (1f893f1)
• Fix broken roadmap links (#2690) (079395a)
• Fix issue when user specifies a port for feast ui (#2692) (00a9de9)
• Python server is not correctly starting in integration tests (#2706) (4525336)
• Support push sources in stream feature views (#2704) (6531685)

v0.21.0

0.21.0 (2022-05-13)

Overview

This release adds many bug fixes, and also adds several new features:

• HBase online store (contrib)
• [Alpha] feast ui command to spin up the Web UI within a feature repository

There is ongoing work towards:

• [Alpha] High performance Go feature server (via feast serve with a go feature server enabled)
• [Alpha] Stream transformations
• [Alpha] Validating logged feature values (from the Go feature server) with Great Expectations and feast validate

Features

• Add hbase online store support in feast (#2590) (c9eda79)
• Adding SSL options for Postgres (#2644) (0e809c2)
• Allow Feast UI to be spun up with CLI command: feast ui (#2667) (44ca9f5)
• Allow to pass secrets and environment variables to transformation service (#2632) (ffa33ad)
• CLI command 'feast serve' should start go-based server if flag is enabled (#2617) (f3ff812)
• Create stream and batch feature view abstractions (#2559) (d1f76e5)
• Postgres supported as Registry, Online store, and Offline store (#2401) (ed2f979)
• Support entity fields in feature view schema parameter by dropping them (#2568) (c8fcc35)
• Write logged features to an offline store (Python API) (#2574) (134dc5f)
• Write logged features to Offline Store (Go - Python integration) (#2621) (ccad832)

Bug Fixes

• Addresses ZeroDivisionError when materializing file source with same timestamps (#2551) (1e398d9)
• Asynchronously refresh registry for the feast ui command (#2672) (1b09ca2)
• Build platform specific python packages with ci-build-wheel (#2555) (b10a4cf)
• Delete data sources from registry when using the diffing logic (#2669) (fc00ca8)
• Enforce kw args featureservice (#2575) (160d7b7)
• Enforce kw args in datasources (#2567) (0b7ec53)
• Feature logging to Redshift is broken (#2655) (479cd51)
• Feature service to templates (#2649) (1e02066)
• Feature with timestamp type is incorrectly interpreted by Go FS (#2588) (e3d9588)
• Fix __hash__ methods (#2556) (ebb7dfe)
• Fix AWS bootstrap template (#2604) (c94a69c)
• Fix broken proto conversion methods for data sources (#2603) (00ed65a)
• Fix case where on demand feature view tab is broken if no custom tabs are passed. (#2682) (01d3568)
• Fix DynamoDB fetches when there are entities that are not found (#2573) (7076fe0)
• Fix Feast UI parser to work with new APIs (#2668) (8d76751)
• Fix java server after odfv update (#2602) (0ca6297)
• Fix materialization with ttl=0 bug (#2666) (ab78702)
• Fix push sources and add docs / tests pushing via the python feature server (#2561) (e8e418e)
• Fixed data mapping errors for Snowflake (#2558) (53c2ce2)
• Forcing ODFV udfs to be main module and fixing false positive duplicate data source warning (#2677) (2ce33cd)
• Include the ui/build directory, and remove package data (#2681) (0384f5f)
• Infer features for feature services when they depend on feature views without schemas (#2653) (87c194c)
• Pin dependencies to nearest major version (#2647) (bb72b7c)
• Pin pip<22.1 to get around breaking change in pip==22.1 (#2678) (d3e01bc)
• Punt deprecation warnings and clean up some warnings. (#2670) (f775d2e)
• Reject undefined features when using get_historical_features or get_online_features (#2665) (36849fb)
• Remove ci extra from the feature transformation server dockerfile (#2618) (25613b4)
• Remove incorrect call to logging.basicConfig (#2676) (8cbf51c)
• Small typo in CLI (#2578) (f372981)
• Switch from join_key to join_keys in tests and docs (#2580) (d66c931)
• Teardown trino container correctly after tests (#2562) (72f1558)
• Update build_go_protos to use a consistent python path (#2550) (f136f8c)
• Update data source timestamp inference error message to make sense (#2636) (3eaf6b7)
• Update field api to add tag parameter corresponding to labels in Feature. (#2610) (689d20b)
• Update java integration tests and add more logging ...

v0.20.2

0.20.2 (2022-04-28)

Bug Fixes

• Feature with timestamp type is incorrectly interpreted by Go FS (#2588) (3ec943a)
• Fix AWS bootstrap template (#2604) (6df5a49)
• Fix broken proto conversion methods for data sources (#2603) (c391216)
• Remove ci extra from the feature transformation server dockerfile (#2618) (a7437fa)
• Update field api to add tag parameter corresponding to labels in Feature. (#2610) (40962fc)
• Use timestamp type when converting unixtimestamp feature type to arrow (#2593) (a1c3ee3)

v0.20.1

0.20.1 (2022-04-20)

Bug Fixes

• Addresses ZeroDivisionError when materializing file source with same timestamps (#2551) (5539c51)
• Build platform specific python packages with ci-build-wheel (#2555) (1757639)
• Enforce kw args featureservice (#2575) (4dce254)
• Enforce kw args in datasources (#2567) (6374634)
• Fix __hash__ methods (#2556) (dd8b854)
• Fix DynamoDB fetches when there are entities that are not found (#2573) (882328f)
• Fix push sources and add docs / tests pushing via the python feature server (#2561) (c5006c2)
• Fixed data mapping errors for Snowflake (#2558) (abd6be7)
• Small typo in CLI (#2578) (8717bc8)
• Switch from join_key to join_keys in tests and docs (#2580) (6130b80)
• Update build_go_protos to use a consistent python path (#2550) (1c523bf)
• Update RedisCluster to use redis-py official implementation (#2554) (c47fa2a)
• Use cwd when getting module path (#2577) (28752f2)

v0.20.0

0.20.0 (2022-04-14)

Highlights

We are delighted to announce the release of Feast 0.20, which introduces many new features and enhancements:

• High performance Python feature serving (through embedding Go and optimized DynamoDB batch gets)
• Many connector improvements and bug fixes (DynamoDB, Snowflake, Spark, Trino)
  • Note: Trino has been officially bundled into Feast. You can now run this with pip install feast[trino]!
• Graduated alpha features (python feature server + push features)
• Feast API changes
• [Experimental] Feast UI as an importable npm module

Detailed changelog:

Bug Fixes

• Add inlined data sources to the top level registry (#2456) (356788a)
• Add new value types to types.ts for web ui (#2463) (ad5694e)
• Add PushSource proto and Python class (#2428) (9a4bd63)
• Add spark to lambda dockerfile (#2480) (514666f)
• Added private_key auth for Snowflake (#2508) (c42c9b0)
• Added Redshift and Spark typecheck to data_source event_timestamp_col inference (#2389) (04dea73)
• Building of go extension fails (#2448) (7d1efd5)
• Bump the number of versions bumps expected to 27 (#2549) (ecc9938)
• Create init files for the proto-generated python dirs (#2410) (e17028d)
• Don't prevent apply from running given duplicate empty names in data sources. Also fix repeated apply of Spark data source. (#2415) (b95f441)
• Dynamodb deduplicate batch write request by partition keys (#2515) (70d4a13)
• Ensure that init files exist in proto dirs (#2433) (9b94f7b)
• Fix DataSource constructor to unbreak custom data sources (#2492) (712653e)
• Fix default feast apply path without any extras (#2373) (6ba7fc7)
• Fix definitions.py with new definition (#2541) (eefc34a)
• Fix entity row to use join key instead of name (#2521) (c22fa2c)
• Fix Java Master (#2499) (e083458)
• Fix registry proto (#2435) (ea6a9b2)
• Fix some inconsistencies in the docs and comments in the code (#2444) (ad008bf)
• Fix spark docs (#2382) (d4a606a)
• Fix Spark template to work correctly on feast init -t spark (#2393) (ae133fd)
• Fix the feature repo fixture used by java tests (#2469) (32e925e)
• Fix unhashable Snowflake and Redshift sources (cd8f1c9)
• Fixed bug in passing config file params to snowflake python connector (#2503) (34f2b59)
• Fixing Spark template to include source name (#2381) (a985f1d)
• Make name a keyword arg for the Entity class (#2467) (43847de)
• Making a name for data sources not a breaking change (#2379) (71d7ae2)
• Minor link fix in CONTRIBUTING.md (#2481) (2917e27)
• Preserve ordering of features in _get_column_names (#2457) (495b435)
• Relax click python requirement to >=7 (#2450) (f202f92)
• Remove date partition column field from datasources that don't s… (#2478) (ce35835)
• Remove docker step from unit test workflow (#2535) (6f22f22)
• Remove spark from the AWS Lambda dockerfile (#2498) (6abae16)
• Request data api update (#2488) (0c9e5b7)
• Schema update (#2509) (cf7bbc2)
• Simplify DataSource.from_proto logic (#2424) (6bda4d2)
• Snowflake api update (#2487) (1181a9e)
• Support passing batch source to streaming sources for backfills (#2523) (90db1d1)
• Timestamp update (#2486) (bf23111)
• Typos in Feast UI error message (#2432) (e14369d)
• Update feature view APIs to prefer keyword args (#2472) (7c19cf7)
• Update file api (#2470) (83a11c6)
• Update Makefile to cd into python dir before running commands (#2437) (ca32155)
• Update redshift api (#2479) (4fa73a9)
• Update some fields optional in UI parser (#2380) (cff7ac3)
• Use a single version of jackson libraries and upgrade to 2.12.6.1 (#2473) (5be1cc6)
• Use dateutil parser to parse materialization times ([#2464](https://github....

v0.19.4

0.19.4 (2022-04-06)

Bug Fixes

• Add spark to lambda dockerfile (#2480) (ba22c28)
• Don't prevent apply from running given duplicate empty names in data sources. Also fix repeated apply of Spark data source. (#2415) (88e01a2)
• Fix DataSource constructor to unbreak custom data sources (#2492) (2115bd0)