TensorFlow Serving using TensorFlow 2.7.0-rc0.
Major Features and Improvements
Breaking Changes
Bug Fixes and Other Changes
- Fix nvidia-docker link at Serving Docker using your GPU (commit: 10216d4)
- Replace --runtime=nvidia flag with --gpus all flag as --runtime=nvidia has been dpreciated from Docker19.03 (commit: 9eb2ea0)
- Update resnet_client_grpc.py example (commit: bb1428d)
- Update resnet_client.py example (commit: cb28fca)
- Update resnet_warmup.py example (commit: 3b52852)
- Update resnet_client.cc example to send image bytes as opposed to JPEG blob. (commit: 91ce5e1)
- Allow model batch size to override num_tflite_interpreters_per_pool (commit: 582dec8)
- Change ThreadPoolFactory API so that it can create thread pools not owned by the factory itself. (commit: 01b3811)
- Fix wrong header for tensorflow Env. (commit: d0c7490)
- Update benchmarks to newer API. (commit: ad08f48)
- Make Internal Change. (commit: 844ff1c)
- Fix aspired_versions_manager_benchmark test failure - eliminate redundant notification (commit: b18406b)
- Make tensorflow_serving's test_main behave similarly to tensorflow/core's test_main, except that the serving's test_main cannot access the benchmark library functions directly. Therefore it has to use wrappers. (commit: 5c6be5d)
- Remove dependency on TF error code string (commit: 40f6281)
- Return early if shared status sees error (commit: e3a8d8e)
- Add more debugging information for RoundToLowestAllowedBatch (commit: 1b049c6)
- Add release notes for tf-serving 2.3.4. (commit: 3a47647)
- Update TF Text to v2.6.0. (commit: ea21333)
- Add release notes for tf-serving 2.4.3 (commit: a5184ce)
- propagate thread_pool in input-split case. (commit: 67e660e)
- Add release notes for tf-serving 2.5.2 (commit: a4f0e56)
- Use InputSplitMetadata in batching-session's SplitInputTask, so it handles the lazy splits case. (commit: a461c55)
- Internal change (commit: 9ec4243)
- Add release notes for tf-serving 2.6.0 (commit: b4c2152)
- Internal build cleanup (commit: e67bc35)
- Internal build cleanup (commit: 6b1a02b)
- Remove references to deleted targets. (commit: d683fa1)
- internal refactor (commit: 7ce29f6)
- Update version for 2.7.0-rc0 release. (commit: c9e2e34)