2.1.0

TensorFlow Serving using TensorFlow 2.1.0

Major Features and Improvements

• Add integration with TensorBoard profiler service.

Breaking Changes

Bug Fixes and Other Changes

• Fix link for TFRecord in Saved Model Warmup documentation. (commit: 127a112)
• Fix typo in http server log message. (commit: 509f6da)
• Be able to discard aspired-versions request from SourceRouter (commit: 10e4987)
• Use public tf.config APIs (commit: 87a4b2b)
• Fix copying of string tensor outputs by explicitly copying each (commit: 9544077)
• Migrate from std::string to tensorflow::tstring. (commit: e24571a)

TensorFlow Serving using TensorFlow 2.1.0-rc1

Release 2.1

Major Features and Improvements

• Be able to discard aspired-versions request from SourceRouter (commit: 10e4987)
• Adds integration with TensorBoard profiler service (commit: 91adea9)

Breaking Changes

Bug Fixes and Other Changes

• Fix link for TFRecord in Saved Model Warmup documentation. (commit: 127a112)
• Use public tf.config APIs (commit: 87a4b2b)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Minglotus-6

1.13.1

TensorFlow Serving using TensorFlow 1.13.2

2.0.0

TensorFlow Serving using TensorFlow 2.0.0

Major Features and Improvements

• Some Tensorflow Text ops have been added to ModelServer (specifically constrained_sequence_op, sentence_breaking_ops, unicode_script_tokenizer, whitespace_tokenizer, wordpiece_tokenizer)

Breaking Changes

• As previously announced123, Contrib ops will not be packaged with Tensorflow, and therefore will not be available in Tensorflow Serving. If serving with Tensorflow Serving >1.15, please ensure your models do not contain any tf.contrib ops. If you are critically dependent on custom ops, please review this guide for instructions to statically build ops into the model server.
• After being deprecated for multiple years, as a part of tf.contrib deprecation, SessionBundle API will be removed starting from Tensorflow Serving 2.0 - if currently using SessionBundle, please migrate to SavedModel APIs.

Bug Fixes and Other Changes

• Add a section in the documentation for testing custom op manually. (commit: 1b65af1)
• Add ops delegate library to enable running TF ops. (commit: 1411235)
• Add command line tool to load TF Lite model for manual testing/debugging. (commit: 0b0254d)
• Fixes broken relative docs links (commit: 1281314)
• Cleaning up BUILD visibility for tf_pyclif_proto_library intermediate targets. (commit: 81ed5ef)
• Remove unused load statements from BUILD files (commit: d0e01a3)
• Manual tests for model server and including tf.Text in serving build. (commit: 142d0ad)
• Remove tensorflow/contrib/session_bundle as dependency for Tensorflow Serving. (commit: 1bdd349)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

chaox

1.15.0

TensorFlow Serving using TensorFlow 1.15.0

Major Features and Improvements

Breaking Changes

• As previously announced, Contrib ops will not be packaged with Tensorflow, and therefore will not be available in Tensorflow Serving. If serving with Tensorflow Serving >1.15, please ensure your models do not contain any tf.contrib ops. If you are critically dependent on custom ops, please review this guide for instructions to statically build ops into the model server.
• After being deprecated for multiple years, as a part of tf.contrib deprecation, SessionBundle API will be removed starting from Tensorflow Serving 2.0 - if currently using SessionBundle, please migrate to SavedModel APIs.

Bug Fixes and Other Changes

• This release is based on TF version 1.15.0

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Abolfazl Shahbazi, chaox, gison93, Minglotus-6, William D. Irons, ynqa

1.15.0-rc2

TensorFlow Serving using TensorFlow 1.15.0-rc3.

1.15.0-rc1

Merge pull request #1446 from minglotus-6/releng_20190924_115434

Update version for 1.15.0-rc1 release.

1.12.3

TensorFlow Serving using TensorFlow 1.12.3

Major Features and Improvements

• No major features or improvements.

Breaking Changes

• No breaking changes

Bug Fixes and Other Changes

• This release is based on TF version 1.12.3.

1.14.0

TensorFlow Serving using TensorFlow 1.14.0.

Major Features and Improvements

• Use MKL-DNN contraction kernels by default. (commit: a075ebe)
• Add option to refuse to unload the last servable version. (commit: c8496b1)
• Add ability to disable periodic filesystem polling (#1295). (commit: 7245055)

Breaking Changes

• No breaking changes.

Bug Fixes and Other Changes

• Add enforce_session_run_timeout inside Server::Options. (commit: de03064)
• Add -o option, to pass params to docker command. (commit: dd59021)
• Stop using reader locks (tf_shared_lock) on the read path of FastReadDynamicPtr. (commit: f04e583)
• Add saved model tags to logging metadata. These tags are used by (commit: 6320701)
• Adds an option in SessionBundleConfig to repeat warmup replay n times per request. (commit: 15cd202)
• Improve tpu server warm up (commit: 63d31a3)
• Official PIP package releases are now tied to a specific version of TensorFlow (commit: 9514c37)
• Bump the minimal Bazel version to 0.24.1 (commit: 96a716c)
• Add new device type for TPU. (commit: c74861d)
• Fix incorrect formatting of decimal numbers in JSON output (#1332) (commit: d7c3b3d)
• Fixed the gzip uncompression support in the HTTP server for large request bodies. (commit: fb7835c)
• Add stack memory resource kind. (commit: e56e72b)
• Adds ModelServer test for loading SavedModel exported from Keras Sequential API (commit: 9578f3d)
• Ignore SIGPIPE for libevent，prevent the SIGPIPE signal from being raised (#1257) (commit: 8d88a5b)
• Fix #1367 (commit: 58af901)
• Update Serving_REST_simple.ipynb (commit: 3870ba5)
• Updates README with link to architecture overview (commit: d233a82)
• Update example section to use Docker (commit: a5fc8bb)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

G. Hussain Chinoy, Karthik Vadla, mkim301, yjhjstz

1.14.0-rc0

TensorFlow Serving using TensorFlow 1.14.0-rc0.

Major Features and Improvements

• Use MKL-DNN contraction kernels by default. (commit: a075ebe)
• Add option to refuse to unload the last servable version. (commit: c8496b1)
• Add ability to disable periodic filesystem polling (#1295). (commit: 7245055)

Breaking Changes

• No breaking changes.

Bug Fixes and Other Changes

• Add enforce_session_run_timeout inside Server::Options. (commit: de03064)
• Add -o option, to pass params to docker command. (commit: dd59021)
• Stop using reader locks (tf_shared_lock) on the read path of FastReadDynamicPtr. (commit: f04e583)
• Add saved model tags to logging metadata. These tags are used by (commit: 6320701)
• Adds an option in SessionBundleConfig to repeat warmup replay n times per request. (commit: 15cd202)
• Improve tpu server warm up (commit: 63d31a3)
• Official PIP package releases are now tied to a specific version of TensorFlow (commit: 9514c37)
• Bump the minimal Bazel version to 0.24.1 (commit: 96a716c)
• Add new device type for TPU. (commit: c74861d)
• Fix incorrect formatting of decimal numbers in JSON output (#1332) (commit: d7c3b3d)
• Fixed the gzip uncompression support in the HTTP server for large request bodies. (commit: fb7835c)
• Add stack memory resource kind. (commit: e56e72b)
• Adds ModelServer test for loading SavedModel exported from Keras Sequential API (commit: 9578f3d)
• Ignore SIGPIPE for libevent，prevent the SIGPIPE signal from being raised (#1257) (commit: 8d88a5b)
• Fix #1367 (commit: 58af901)
• Update Serving_REST_simple.ipynb (commit: 3870ba5)
• Updates README with link to architecture overview (commit: d233a82)
• Update example section to use Docker (commit: a5fc8bb)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

G. Hussain Chinoy, Karthik Vadla, mkim301, yjhjstz