Summary

New Features

• ScatterNd Operator Implementation.
  • Added support to delegate and opaque delegate.
  • Added support to Serializer and Deserializer.
  • Added support to TFLite parser.
  • End to End tests added.
  • Added support for CpuRef and GpuAcc.
• Adding options to serialize networks in ExecuteNetwork.
• Add a build option to enable the OpenMP scheduler in ACL and made it the default scheduler for ACL builds.
• Add Boolean data type to Debug layer support.
• Update TOSA Common and TosaRef to use TOSA v0.80.
• Update build-tool README to include macOS support.

Bug Fixes

• ExecuteNetwork fix for abort after inference.
• Fix for failing CTS Float16 tests.
• Enable serialize-to-armnn only when ARMNN_SERIALIZER is on.
• TosaCommon backend
  • In TosaCommon, modify the way the unique names for the inputs are generated.
  • CreateRescaleTosaOperator() modified.
  • Move ComputeSplitAxis() to backendsCommon/WorkloadUtils.
  • For LeakyRelu, add TosaRefEndToEndTests and enable FP16 in TOSA mapping.
  • Fix quantized Conv2d TOSA mapping.
• Broadcast handling for Comparison layer is inconsistent.
• Remove limitations on zero scale value in quantization.
• Fix failing fsrcnn test.
• Fix broken link in the delegate README.
• Fix runtime memory handling in delegate and Arm NN executor.
• Remove use of std::clamp.
• Syntax change to allow building on older compilers.
• Assert audit and removal.

Other Changes

• Deprecation notices for items to be removed in 24.08 release.
• Review and update documentation for operators added in 24.05 release.
• Update to Arm NN documentation for 24.05 release.
• Update python pillow version.
• Remove reference to 22.08 release in docker README.
• Minor change to the printouts in ExecuteNetwork.
• Enable build of execute network in build tool.
• Arm NN build tool script update for delegate header and so files.

ABI/API Changes

No API breaking front-end changes have occurred during the implementation of 24.05.

No API breaking back-end changes have occurred during the implementation of 24.05.

Build Dependencies