Model compression and simplification pipelines for fast deep neural network inference in FPGAs in HEP
Abstract
Resource utilization plays a crucial role for successful implementation of fast real-time inference for deep neural networks (DNNs) and convolutional neural networks (CNNs) on latest generation of hardware accelerators (FPGAs, SoCs, ACAPs, GPUs). To fulfil the needs of the triggers that are in development for the upgraded LHC detectors, we have developed a multi-stage compression approach based on conventional compression strategies (pruning and quantization) to reduce the memory footprint of the model and knowledge transfer techniques, crucial to streamline the DNNs simplifying the synthesis phase in the FPGA firmware and improving explainability. We present the developed methodologies and the results of the implementation in a working engineering pipeline used as pre-processing stage to high level synthesis tools (HLS4ML, Xilinx Vivado HLS, etc.). We show how it is possible to build ultra-light deep neural networks in practice, by applying the method to a realistic HEP use-case: a toy simulation of one of the triggers planned for the HL-LHC. Show more
Permanent link
https://doi.org/10.3929/ethz-b-000515115Publication status
publishedExternal links
Journal / series
The European Physical Journal CVolume
Pages / Article No.
Publisher
SpringerOrganisational unit
03593 - Dissertori, Günther / Dissertori, Günther
Related publications and datasets
Is referenced by: https://doi.org/10.1140/epjc/s10052-021-09875-2
More
Show all metadata