TensorFlow Serving using TensorFlow 2.3.0-rc2
Major Features and Improvements
- Update TF Text to v2.2.0. (commit: f8ea95d)
Breaking Changes
Bug Fixes and Other Changes
- Add a ThreadPoolFactory abstraction for returning inter- and intra- thread pools, and update PredictRequest handling logic to use the new abstraction. (commit: 8e3a00c)
- Update Dockerfile.devel* with py3.6 installed. (commit: b3f46d4)
- Add more metrics for batching. (commit: f0bd9cf)
- Plug ThreadPoolFactory into Classify request handling logic. (commit: 975f474)
- Plug ThreadPoolFactory into Regress request handling logic. (commit: ff9ebf2)
- Plug ThreadPoolFactory into MultiInference request handling logic. (commit: 9a2db1d)
- Allow batch size of zero in row format JSON (commit: fee9d12)
- Support for MLMD(https://www.tensorflow.org/tfx/guide/mlmd) broadcast in TensorFlow serving. (commit: 4f8d3b7)
- Adds support for SignatureDefs stored in metadata buffers to tflite sessions (commit: 4867fed)
- Add support for version labels to REST API (Fixes #1555). (commit: 3df0362)
- Update TF Text regression model to catch errors thrown from within ops. (commit: 425d596)
- Upgrade to CUDA Version 10.1. (commit: fd5a2a2)
- Migrates profiler_client trace to the new api in tensorflow_model_server_test. (commit: 8d7d1d6)
Thanks to our Contributors
This release contains contributions from many people at Google.