Scalable Hierarchical Instruction Cache for Ultralow-Power Processors Clusters
Metadata only
Date
2023-04Type
- Journal Article
Abstract
High performance and energy efficiency are critical requirements for Internet of Things (IoT) end-nodes. Exploiting tightly coupled clusters of programmable processors (CMPs) has recently emerged as a suitable solution to address this challenge. One of the main bottlenecks limiting the performance and energy efficiency of these systems is the instruction cache architecture due to its criticality in terms of timing (i.e., maximum operating frequency), bandwidth, and power. We propose a hierarchical instruction cache tailored to ultralow-power (ULP) tightly coupled processor clusters where a relatively large cache (L1.5) is shared by L1 private (PR) caches through a two-cycle latency interconnect. To address the performance loss caused by the L1 capacity misses, we introduce a next-line prefetcher with cache probe filtering (CPF) from L1 to L1.5. We optimize the core instruction fetch (IF) stage by removing the critical core-to-L1 combinational path. We present a detailed comparison of instruction cache architectures' performance and energy efficiency for parallel ULP (PULP) clusters. Focusing on the implementation, our two-level instruction cache provides better scalability than existing shared caches, delivering up to 20% higher operating frequency. On average, the proposed two-level cache improves maximum performance by up to 17% compared to the state-of-the-art while delivering similar energy efficiency for most relevant applications. Show more
Publication status
publishedExternal links
Journal / series
IEEE Transactions on Very Large Scale Integration (VLSI) SystemsVolume
Pages / Article No.
Publisher
IEEESubject
Energy efficiency; instruction cache; parallel; prefetch; ultralow-power (ULP)Organisational unit
03996 - Benini, Luca / Benini, Luca
Funding
101034126 - Pilot using Independent Local & Open Technologies (EC)
More
Show all metadata