New Features:
- Prebuilt ModelServer binary installable with apt-get and a PIP package for the Python client API. Install instructions can be found here.
- Extended stable API: In addition to the original Predict function, we added Regress, Classify, and MultiInference. See the PredictionService for proto definitions.
- Batching scheduler moved into TensorFlow, and used in new Batch/Unbatch ops.
- Propagate ModelServer RPC deadline to Session::Run().
Updates:
- Deprecated SessionBundle format.
- SessionBundle is deprecated. The ModelServer still works with it for now, but support is going away in the near future so it's no longer officially supported. Please move to use SavedModel instead.
- Moved documentation to tensorflow.org along with the rest of TensorFlow - https://www.tensorflow.org/serving.
- Various bug fixes and code cleanups.
- Improved documentation and updated all codelabs to work with SavedModel.