ARM-software/armnn v25.02 on GitHub

Arm NN SDK

TosaRef mapping bug fixes for Operators LeakyRelu, Quantize, Stack, Dequantize
TosaRef refactorisation and bug fixes for a range of different Operators.
TosaRef Strided Slice Error.
TfLite Turbo Model Detection Fix.
Added a check to ensure activation is within the current subgraph before fusion in Neon and CL backends.

The following front-end API changes have occurred during the implementation of 25.02, which users should be aware of before upgrading.

Due to these, changes we have bumped our ARMNN_VERSION to 35.0.0, following Semantic Versioning guidelines.

Feature

SHA

Gerrit Review

Resultant ABI/API Changes

Remove Async API

The IWorkingMemHandle class has been removed.

The IAsyncExecutionCallback class has been removed.

INetworkProperties structure has had the following fields removed:

4 functions have been removed from the IRuntime class:

IRuntime::ClearImportedInputs ( NetworkId networkId, std::vector<unsigned int>const inputIds )
IRuntime::ClearImportedOutputs ( NetworkId networkId, std::vector<unsigned int>const outputIds )
IRuntime::CreateWorkingMemHandle ( NetworkId networkId )
IRuntime::Execute ( experimental::IWorkingMemHandle& workingMemHandle, InputTensors const& inputTensors, OutputTensors const& outputTensors, std::vector<unsigned int> preImportedInputs, std::vector<unsigned int> preImportedOutputs )

The Threadpool class along with its functions have been removed:

Threadpool::LoadMemHandles ( std::vector<std::shared_ptr<IWorkingMemHandle> > memHandles )
Threadpool::Schedule ( armnn::NetworkId networkId, armnn::InputTensors const& inputTensors, armnn::OutputTensors const& outputTensors, enum armnn::QosExecPriority const priority, std::shared_ptr<IAsyncExecutionCallback> cb )
Threadpool::TerminateThreadPool ( )
Threadpool::Threadpool [C1] ( std::size_t numThreads, armnn::IRuntime* runtimePtr, std::vector<std::shared_ptr<IWorkingMemHandle> > memHandles )
Threadpool::Threadpool [C2] ( std::size_t numThreads, armnn::IRuntime* runtimePtr, std::vector<std::shared_ptr<IWorkingMemHandle> > memHandles )
Threadpool::UnloadMemHandles ( armnn::NetworkId networkId )