tensorflow/serving 2.3.0

on GitHub

TensorFlow Serving using TensorFlow 2.3.0

Bug Fixes and Other Changes

• Add a ThreadPoolFactory abstraction for returning inter- and intra- thread pools, and update PredictRequest handling logic to use the new abstraction. (commit: 8e3a00c)
• Update Dockerfile.devel* with py3.6 installed. (commit: b3f46d4)
• Add more metrics for batching. (commit: f0bd9cf)
• Rename method to clarify intent. (commit: 9feac12)
• Plug ThreadPoolFactory into Classify request handling logic. (commit: 975f474)
• Plug ThreadPoolFactory into Regress request handling logic. (commit: ff9ebf2)
• Plug ThreadPoolFactory into MultiInference request handling logic. (commit: 9a2db1d)
• Add a tflite benchmark for Mobilenet v1 quant (commit: e266822)
• Allow batch size of zero in row format JSON (commit: fee9d12)
• Add tests for zero-sized batch (commit: b064c1d)
• Support for MLMD(https://www.tensorflow.org/tfx/guide/mlmd) broadcast in TensorFlow serving. (commit: 4f8d3b7)
• Fix docker based builds (fixes #1596) (commit: ca2e003)
• Fix order dependency in batching_session_test. (commit: 58540f7)
• Split BasicTest in machine_learning_metadata_test into multiple test methods without order dependency. (commit: 745c735)
• Revert pinning the version for "com_google_absl". (commit: ff9e950)
• Minimize the diffs between mkl and non-mkl Dockerfiles (commit: e783014)
• Pin "com_google_absl" at the same version(with same patch) with Tensorflow. (commit: f46b88a)
• Update TF Text to v2.2.0. (commit: f8ea95d)
• fix broken web link (commit: 0cb123f)
• Test zero-sized batch with tensors of different shapes (commit: 1f7aebd)
• Test inconsistent batch size between zero and non-zero (commit: 91afd42)
• Fix broken GetModelMetadata request processing (#1612) (commit: c1ce075)
• Adds support for SignatureDefs stored in metadata buffers to tflite sessions (commit: 4867fed)
• Update ICU library to include knowledge of built-in data files. (commit: c32ebd5)
• Add support for version labels to REST API (Fixes #1555). (commit: 3df0362)
• Update TF Text regression model to catch errors thrown from within ops. (commit: 425d596)
• Upgrade to CUDA Version 10.1. (commit: fd5a2a2)
• Migrates profiler_client trace to the new api in tensorflow_model_server_test. (commit: 8d7d1d6)
• Update the testing model for TRT to fix the test. (commit: 28f812d)
• Add release notes for TF Serving 2.2.0 (commit: 54475e6)
• Update bazel version requirement and version used in the docker images to match with TF (3.0.0). (commit: 56854d3)
• Fixes instructions on sample commands to serve a model with docker. (commit: a5cd1ca)
• Change use_tflite_model to prefer_tflite_model to allow multi-tenancy of Tensorflow models with Tensorflow Lite models. (commit: 8589d81)
• Introducing Arena usage to TensorFlow Serving's HTTP handlers. (commit: a33978c)
• Fix tensorflow::errors:* calls, which use StrCat instead of StrFormat (commit: 2c0bcec)
• Instrumentation for BatchingSession: (commit: 3ca9e89)
• adjust error message for incorrect keys of instances object (commit: 83863b8)
• Update rules_pkg to latest (0.2.5) release. (commit: 932358e)
• In batching session, implement the support for 'enable_large_batch_splitting'. (commit: d7c6a65)
• Update version for 2.3.0-rc0 release. (commit: 3af3303)
• Set cuda compute capabilities for cuda build config. (commit: 731a34f)
• Update version for 2.3.0 release. (commit: 8b4c709)

Thanks to our Contributors

This release contains contributions from many people at Google.