Overview
Today we are releasing Feast 0.15, which includes performance improvements, bug fixes, and several features:
- [Experimental] Push based stream ingestion (docs): Feast now allows users to push features previously registered in a feature view to the online store. This most commonly would be done from a stream processing job (e.g. a Beam or Spark Streaming job).
- Entity aliasing (docs): This allows for use cases where the same entity has different column names in different source tables (e.g. there are "spammer", "reporter", and "user" tables that all refer to the same user entity).
- Feature Transformation Server: a server that executes on demand transformations. The existing feature server (e.g. deployed with AWS Lambda) executes on demand transformations already. This new server integrates with Feast Serving (java server) for latency sensitive usecases.
- Easy way to test offline/online store plugins using the existing Feast test suite. See docs for details.
Experimental features are subject to API changes in the near future as we collect feedback. If you have thoughts, please don’t hesitate to reach out to the Feast team!
👥 Contributors
Thanks to @achals, @adchia, @Agent007, @amommendes, @codyjlin, @DvirDukhan, @felixwang9817, @judahrand, @loftiskg, @mavysavydav, @MattDelac, @nossrannug, @pyalex, @qooba, @samuel100, @tsotnet, @vas28r13, and @ysk24ok for the contributions!
✨ New Features:
- Feature transformation server docker image #1972 (felixwang9817)
- eventtime check before writing features, use pipelines, ttl #1961 (vas28r13)
- Plugin repo universal tests #1946 (felixwang9817)
- direct data ingestion into Online store #1939 (vas28r13)
- Add an interface for TransformationService and a basic implementation #1932 (achals)
- Allows registering of features in request data as RequestFeatureView. Refactors common logic into a BaseFeatureView class #1931 (adchia)
- Add final_output_feature_names in Query context to avoid SELECT * EXCEPT #1911 (MattDelac)
- Add Dockerfile for GCP CloudRun FeatureServer #1887 (judahrand)
🔴 Fixed bugs:
- feast=0.14.0
query_generator()unecessary used twice #1978 - get_online_features on demand transform bug fixes + local integration test mode #2004 (adchia)
- Always pass full and partial feature names to ODFV #2003 (judahrand)
- Update bq_to_feast_value_type with BOOLEAN type as a legacy sql data type #1996 (mavysavydav)
- Fix bug where using some Pandas dtypes in the output of an ODFV fails #1994 (judahrand)
- Fix duplicate update infra #1990 (felixwang9817)
- Improve performance of _convert_arrow_to_proto #1984 (nossrannug)
- Fix duplicate upload entity #1981 (achals)
- fix redis cluster materialization #1968 (qooba)
- Allow plugin repos to actually overwrite repo configs #1966 (felixwang9817)
- Delete keys from Redis when tearing down online store #1965 (achals)
- Fix issues with lint test and upgrade pip version #1964 (felixwang9817)
- Move IntegrationTestRepoConfig class to another module #1962 (felixwang9817)
- Solve package conflict in [gcp] and [ci] #1955 (ysk24ok)
- Remove some paths from unit test cache #1944 (achals)
- Fix bug in feast alpha enable CLI command #1940 (felixwang9817)
- Fix conditional statements for if OnDemandFVs exist #1937 (codyjlin)
- Fix __getitem__ return value for feature view and on-demand feature view #1936 (mavysavydav)
- Corrected setup.py BigQuery version that's needed for a contributor's merged PR 1844 #1934 (mavysavydav)
🔨 Merged pull requests:
- Fix protobuf version conflict in [gcp] and [ci] packages #1992 (ysk24ok)
- Improve aws lambda deployment (logging, idempotency, etc) #1985 (tsotnet)
- Extend context for usage statistics collection & add latencies for performance analysis #1983 (pyalex)
- Update CHANGELOG for Feast v0.14.1 #1982 (felixwang9817)
- Document AWS Lambda permissions #1970 (tsotnet)
- Update online store helper docstring #1957 (amommendes)
- Add public docs for entity aliasing #1951 (codyjlin)
- Updating roadmap + hero image #1950 (adchia)
- Add David and Matt as approvers as well #1943 (achals)
- Add David and Matt as reviewers, and add actions for issue/PR assignment #1942 (achals)
- Simplify BigQuery load jobs #1935 (judahrand)