🍱 BentoML v1.0.3 release has brought a list of performance and feature improvement.
-
Improved Runner IO performance by enhancing the underlying serialization and deserialization, especially in models with large input and output sizes. Our image input benchmark showed a 100% throughput improvement.
-
Added support for specifying URLs to exclude from tracing.
🙌 We continue to receive great engagement and support from the BentoML community.
- Shout out to Ben Kessler for helping benchmarking performance.
- Shout out to Jiew Peng Lim for adding the support for configuring URLs to exclude from tracing.
- Shout out to Susana Bouchardet for add the support for JSON IO Descriptor to return empty response body.
- Thanks to Keming and mplk for contributing their first PRs in BentoML.
What's Changed
- chore(deps): bump actions/setup-node from 2 to 3 by @dependabot in #2846
- fix: extend --cache-from consumption to python tuple by @anwang2009 in #2847
- feat: add support for excluding urls from tracing by @jiewpeng in #2843
- docs: update notice about buildkit by @aarnphm in #2837
- chore: add CODEOWNERS by @aarnphm in #2842
- doc(frameworks): tensorflow by @bojiang in #2718
- feat: add support for specifying urls to exclude from tracing as a list by @jiewpeng in #2851
- fix(configuration): merging global runner config to runner specific config by @jjmachan in #2849
- fix: Setting status code and cookies by @ssheng in #2854
- chore: README typo by @kemingy in #2859
- chore: gallery links to
bentoml/examples
by @aarnphm in #2858 - fix(runner): use pickle instead for multi payload parameters by @aarnphm in #2857
- doc(framework): pytorch guide by @bojiang in #2735
- docs: add missing
output
to Runner docs by @mplk in #2868 - chore: fix push and load interop by @aarnphm in #2863
- fix: Usage stats by @ssheng in #2876
- fix:
JSON(IODescriptor[JSONType]).to_http_response
returns empty body when the response isNone
. by @sbouchardet in #2874 - chore: Address comments in the #2874 by @ssheng in #2877
- fix: debugger breaks on circus process by @aarnphm in #2875
- feat: support custom components for OpenAPI generation by @aarnphm in #2845
New Contributors
- @anwang2009 made their first contribution in #2847
- @jiewpeng made their first contribution in #2843
- @kemingy made their first contribution in #2859
- @mplk made their first contribution in #2868
- @sbouchardet made their first contribution in #2874
Full Changelog: v1.0.2...v1.0.3