Embedded neuromorphic attention model leveraging a novel low-power heterogeneous platform
METADATA ONLY
Loading...
Author / Producer
Date
2023
Publication Type
Conference Paper
ETH Bibliography
yes
Citations
Altmetric
METADATA ONLY
Data
Rights / License
Abstract
Neuromorphic computing has been identified as an ideal candidate to exploit the potential of event-based cameras, a promising sensor for embedded computer vision. However, state-of-the-art neuromorphic models try to maximize the model performance on large platforms rather than a trade-off between memory requirements and performance. We present the first deployment of an embedded neuromorphic algorithm on Kraken, a low-power RISC-V-based SoC prototype including a neuromorphic spiking neural network (SNN) accelerator. In addition, the model employed in this paper was designed to achieve visual attention detection on event data while minimizing the neuronal populations’ size and the inference latency. Experimental results show that it is possible to achieve saliency detection in event data with a delay of 32ms, maintains classification accuracy of 84.51% and consumes only 3.85mJ per second of processed input data, achieving all of this while processing input data 10 times faster than real-time. This trade-off between decision latency, power consumption, accuracy, and run time significantly outperforms those achieved by previous implementations on CPU and neuromorphic hardware.
Permanent link
Publication status
published
Editor
Book title
2023 IEEE 5th International Conference on Artificial Intelligence Circuits and Systems (AICAS)
Journal / series
Volume
Pages / Article No.
10168603
Publisher
IEEE
Event
5th International Conference on Artificial Intelligence Circuits and Systems (AICAS 2023)
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
Neuromorphic; Embedded system; Event camera; Academic platform
Organisational unit
03996 - Benini, Luca / Benini, Luca
Notes
Funding
186991 - Analog PROcessing of bioinspired VIsion Sensors for 3D reconstruction (SNF)