neuralmagic/deepsparse v0.11.1

DeepSparse v0.11.1 Patch Release

on GitHub

This is a patch release for 0.11.0 that contains the following changes:

• When running NanoDet-Plus-m, the DeepSparse Engine will no longer fail with an assertion (See #279).
• The DeepSparse Engine now respects the cpu affinity set by the calling thread. This is essential for the new Command-line (CLI) tool multi-process-benchmark.py to function correctly. This script allows users to measure the performance using multiple separate processes in parallel.
• Fixed a performance regression on BERT batch size 1 sequence length 128 models.