github neuralmagic/deepsparse v0.1.0
DeepSparse v0.1.0 First GitHub Release

latest releases: v1.7.1, v1.7.0, v1.6.1...
3 years ago

Welcome to our initial release on GitHub! Older release notes can be found here.

New Features:

  • Operator support enabled:
    • QLinearAdd
    • 2D QLinearMatMul when the second operand is constant
  • Multi-stream support added for concurrent requests.
  • Examples for benchmarking, classification flows, detection flows, and Flask servers added.
  • Jupyter Notebooks for classification and detection flows added.
  • MakeFile flows and utilities implemented for GitHub repo structure.

Changes:

  • Software packaging updated to reflect new GitHub distribution channel, from file naming conventions to license enforcement removal.
  • Initial startup message updated with improved language.
  • Distribution now manylinux2014 compliant; support for Ubuntu 16.04 deprecated.
  • QuantizeLinear operations now use division instead of scaling by reciprocal for small quantization scales.
  • Small performance improvements made on some quantized networks with nontrivial activation zero points.

Resolved Issues:

  • Networks with sparse quantized convolutions and nontrivial activation zero points now have consistent correct results.
  • Crash no longer occurs for some models where a quantized depthwise convolution follows a non-depthwise quantized convolution.

Known Issues:

  • None

Don't miss a new deepsparse release

NewReleases is sending notifications on new releases.