feast-dev/feast v0.13.0

Feast v0.13.0

on GitHub

Overview

Today we are releasing Feast 0.13, which includes 3 new features:

1. [Experimental] On demand feature views, which allow for consistently applied transformations in both training and online paths. This also introduces the concept of request data, which is data only available at the time of the prediction request, as potential inputs into these transformations (see docs)
2. [Experimental] Python feature servers, which allow you to quickly deploy a local HTTP server to serve online features. Serverless deployments and java feature servers to come soon! (see docs)
3. Feature views without entities, which allow you to specify features that should only be joined on event timestamps. You do not need lists of entities / entity values when defining and retrieving features from these feature views. (see docs)

Experimental features are subject to API changes in the near future as we collect feedback. If you have thoughts, please don’t hesitate to reach out to the Feast team!

👥 Contributors

Thanks to @achals, @adchia, @baineng, @codyjlin, @DvirDukhan, @felixwang9817, @GregKuhlmann, @guykhazma, @hamzakpt, @judahrand, @jdamji, @LarsKlingen, @MattDelac, @mavysavydav, @mmurdoch, @qooba, @tedhtchang, @samuel100, @tsotnet, and @WingCode for the contributions!

💥 Breaking changes:

• Enforce case-insensitively unique feature view names #1835 (codyjlin)
• Add init to Provider contract #1796 (woop)

✨ New Features:

• Add on demand feature view experimental docs #1880 (adchia)
• Adding telemetry for on demand feature views and making existing usage calls async #1873 (adchia)
• Read registry & config from env variables in AWS Lambda feature server #1870 (tsotnet)
• Add feature server configuration for AWS lambda #1865 (felixwang9817)
• Add MVP support for on demand transforms for AWS to_s3 and to_redshift #1856 (adchia)
• Add MVP support for on demand transforms for bigquery #1855 (adchia)
• Add arrow support for on demand feature views #1853 (adchia)
• Support adding request data in on demand transforms #1851 (adchia)
• Support on demand feature views in feature services #1849 (achals)
• Infer features for on demand feature views, support multiple output features #1845 (achals)
• Add Registry and CLI operations for on demand feature views #1828 (achals)
• Implementing initial on demand transforms for historical retrieval to_df #1824 (adchia)
• Registry store plugin #1812 (DvirDukhan)
• Enable entityless featureviews #1804 (codyjlin)
• Initial scaffolding for on demand feature view #1803 (adchia)
• Add s3 support (with custom endpoints) #1789 (woop)
• Local feature server implementation (HTTP endpoint) #1780 (tsotnet)

🔴 Fixed bugs:

• Array/list feature materialization in BQ crashes in type conversion #1839
• Fixing odfv cli group description #1890 (adchia)
• Fix list feature format for BigQuery offline datasources. #1889 (judahrand)
• Add dill to main dependencies #1886 (judahrand)
• Fix pytest_collection_modifyitems to select benchmark tests only #1874 (achals)
• Add support for multiple entities in Redshift #1850 (felixwang9817)
• Move apply(dummy_entity) to apply time to ensure it persists in FeatureStore #1848 (codyjlin)
• Add schema parameter to RedshiftSource #1847 (felixwang9817)
• Pass bigquery job object to get_job #1844 (LarsKlingen)
• Simplify _python_value_to_proto_value by looking up values in a dict #1837 (achals)
• Update historical retrieval integration test for on demand feature views #1836 (achals)
• Fix flaky connection to redshift data API #1834 (achals)
• Init registry during create_test_environment #1829 (achals)
• Randomly generating new BQ dataset for offline_online_store_consistency test #1818 (adchia)
• Ensure docstring tests always teardown #1817 (felixwang9817)
• Use get_multi instead of get for datastore reads #1814 (achals)
• Fix Redshift query for external tables #1810 (woop)
• Use a random dataset and table name for simple_bq_source #1801 (achals)
• Refactor Environment class and DataSourceCreator API, and use fixtures for datasets and data sources #1790 (achals)
• Fix get_online_features telemetry to only log every 10000 times #1786 (felixwang9817)
• Add a description field the Feature Service class and proto #1771 (achals)
• Validate project name upon feast.apply #1766 (tedhtchang)

🔨 Merged pull requests:

• Add ValueType.NULL #1893 (judahrand)
• Adding more details to the CONTRIBUTING.md #1888 (adchia)
• Parse BQ DATETIME and TIMESTAMP #1885 (judahrand)
• Add durations to list the slowest tests #1881 (achals)
• Upload benchmark information to S3 after integration test runs #1878 (achals)
• Refactor providers to remove duplicate implementations #1876 (achals)
• Add Felix & Danny to code owners file #1869 (tsotnet)
• Initial docker image for aws lambda feature server #1866 (tsotnet)
• Add flags file to include experimental flags and test/usage flags #1864 (adchia)
• Hookup pytest-benchmark to online retreival #1858 (achals)
• Add feature server docs & small changes in local server #1852 (tsotnet)
• Add roadmap to README.md #1843 (woop)
• Enable the types test to run on all compatible environments #1840 (adchia)
• Update reviewers/approvers to include Danny/Felix #1833 (adchia)
• Fix wrong links in README #1832 (baineng)
• Remove older offline/online consistency tests #1831 (achals)
• Replace individual cli tests with parametrized tests #1830 (achals)
• Reducing wait interval for BQ integration tests #1827 (adchia)
• Reducing size of universal repo to decrease integration test time #1826 (adchia)
• Refactor the datastore online_read method to be slightly more efficient #1819 (achals)
• Remove old doc #1815 (achals)
• Rename telemetry to usage #1800 (felixwang9817)
• Updating quickstart colab to explain more concepts and highlight value prop of Feast #1799 (adchia)
• Fix Azure Terraform installation. #1793 (mmurdoch)
• Disable integration test reruns to identify flaky tests #1787 (achals)
• Rerun failed python integration tests #1785 (achals)
• Add Redis to the universal integration tests #1784 (achals)
• Add online feature retrieval integration test using the universal repo #1783 (achals)
• Fix wrong description in README.md #1779 (WingCode)
• Clean up docstring tests #1778 (felixwang9817)
• Add offline retrival integration tests using the universal repo #1769 (achals)
• Adding initial type support related tests for BQ #1768 (adchia)