Overview
Upgrades
MLServer supports Pydantic V2.
Features
MLServer supports streaming data to and from your models.
Streaming support is available for both the REST and gRPC servers:
- for the REST server is limited only to server streaming. This means that the client sends a single request to the server, and the server responds with a stream of data.
- for the gRPC server is available for both client and server streaming. This means that the client sends a stream of data to the server, and the server responds with a stream of data.
See our docs and example for more details.
What's Changed
- fix(ci): fix typo in CI name by @sakoush in #1623
- Update CHANGELOG by @github-actions in #1624
- Re-generate License Info by @github-actions in #1634
- Fix mlserver_huggingface settings device type by @geodavic in #1486
- fix: Adjust HF tests post-merge of PR #1486 by @sakoush in #1635
- Update README.md w licensing clarification by @paulb-seldon in #1636
- Re-generate License Info by @github-actions in #1642
- fix(ci): optimise disk space for GH workers by @sakoush in #1644
- build: Update maintainers by @jesse-c in #1659
- fix: Missing f-string directives by @jesse-c in #1677
- build: Add Catboost runtime to Dependabot by @jesse-c in #1689
- Fix JSON input shapes by @ReveStobinson in #1679
- build(deps): bump alibi-detect from 0.11.5 to 0.12.0 by @jesse-c in #1702
- build(deps): bump alibi from 0.9.5 to 0.9.6 by @jesse-c in #1704
- Docs correction - Updated README.md in mlflow to match column names order by @vivekk0903 in #1703
- fix(runtimes): Remove unused Pydantic dependencies by @jesse-c in #1725
- test: Detect generate failures by @jesse-c in #1729
- build: Add granularity in types generation by @jesse-c in #1749
- Migrate to Pydantic v2 by @jesse-c in #1748
- Re-generate License Info by @github-actions in #1753
- Revert "build(deps): bump uvicorn from 0.28.0 to 0.29.0" by @jesse-c in #1758
- refactor(pydantic): Remaining migrations for deprecated functions by @jesse-c in #1757
- Fixed openapi dataplane.yaml by @RobertSamoilescu in #1752
- fix(pandas): Use Pydantic v2 compatible type by @jesse-c in #1760
- Fix Pandas codec decoding from numpy arrays by @lhnwrk in #1751
- build: Bump versions for Read the Docs by @jesse-c in #1761
- docs: Remove quotes around local TOC by @jesse-c in #1764
- Spawn worker in custom environment by @lhnwrk in #1739
- Re-generate License Info by @github-actions in #1767
- basic contributing guide on contributing and opening a PR by @bohemia420 in #1773
- Inference streaming support by @RobertSamoilescu in #1750
- Re-generate License Info by @github-actions in #1779
- build: Lock GitHub runners' OS by @jesse-c in #1765
- Removed text-model form benchmarking by @RobertSamoilescu in #1790
- Bumped mlflow to 2.13.1 and gunicorn to 22.0.0 by @RobertSamoilescu in #1791
- Build(deps): Update to poetry version 1.8.3 in docker build by @sakoush in #1792
- Bumped werkzeug to 3.0.3 by @RobertSamoilescu in #1793
- Docs streaming by @RobertSamoilescu in #1789
- Bump uvicorn 0.30.1 by @RobertSamoilescu in #1795
- Fixes for all-runtimes by @RobertSamoilescu in #1794
- Fix BaseSettings import for pydantic v2 by @RobertSamoilescu in #1798
- Bumped preflight version to 1.9.7 by @RobertSamoilescu in #1797
- build: Install dependencies only in Tox environments by @jesse-c in #1785
- Bumped to 1.6.0.dev2 by @RobertSamoilescu in #1803
- Fix CI/CD macos-huggingface by @RobertSamoilescu in #1805
- Fixed macos kafka CI by @RobertSamoilescu in #1807
- Update poetry lock by @RobertSamoilescu in #1808
- Re-generate License Info by @github-actions in #1813
- Fix/macos all runtimes by @RobertSamoilescu in #1823
- fix: Update stale reviewer in licenses.yml workflow by @sakoush in #1824
- ci: Merge changes from master to release branch by @sakoush in #1825
New Contributors
- @paulb-seldon made their first contribution in #1636
- @ReveStobinson made their first contribution in #1679
- @vivekk0903 made their first contribution in #1703
- @RobertSamoilescu made their first contribution in #1752
- @lhnwrk made their first contribution in #1751
- @bohemia420 made their first contribution in #1773
Full Changelog: 1.5.0...1.6.0