tensorflow/serving 2.4.0-rc2 on GitHub

TensorFlow Serving using TensorFlow 2.4.0-rc2

Major Features and Improvements

Update TF Text to v2.3.0. (commit: 390732a)
Migrate the remaining references of tf.app to compat.v1. (commit: 06fbf87)
Enable a way to 'forget' unloaded models in the ServableStateMonitor. (commit: 53c5a65)d91cd4a00)
Added abstract layer for remote predict op over different RPC protocols with template. (commit: c54ca7e)
Adds user guide for Remote Predict Op (commit: fc82463)
Add support for serving regress/classify (native) TF2 models. (commit: b724ced)
For batching session in TF serving model server, introduce options to enable large batch splitting. (commit: f84187e)
Add multi-inference support for TF2 models that use (commit: abb8d3b)
Change the SASS & PTX we ship with TF (commit: 0869292)
Adding custom op support. (commit: 892ea42)
Upgrade to PY3 for tests. (commit: 02624a8)
Upgrade to CUDA Version 11.0. (commit: b291c4d)
Broaden net_http client visibility and use HTTPStatusCode in ClientResponse status (commit: 7292714)
In model warm-up path, re-write error code out-of-range (intended when reading EOF in a file) to ok. (commit: d9bde73)
Update CUDNN_VERSION to 8.0.4.30. (commit: 84e0189)
Support multiple SignatureDefs by key in TFLite models (commit: 2e14cd9)
Add dedicated aliases field to ModelServerConfig. (commit: 718152d)
Add portpicker module required to run modelserver e2e tests. (commit: 82f8cc0)
Minimal commandline client to trigger profiler on the modelserver. (commit: c0a5619)
Add signature name to RPOp. (commit: 84dfc8b)

This release contains contributions from many people at Google.