M100 ExaData: a data collection campaign on the CINECA's Marconi100 Tier-0 supercomputer
OPEN ACCESS
Loading...
Author / Producer
Date
2023-05-18
Publication Type
Journal Article
ETH Bibliography
yes
Citations
Altmetric
OPEN ACCESS
Data
Rights / License
Abstract
Supercomputers are the most powerful computing machines available to society. They play a central role in economic, industrial, and societal development. While they are used by scientists, engineers, decision-makers, and data-analyst to computationally solve complex problems, supercomputers and their hosting datacenters are themselves complex power-hungry systems. Improving their efficiency, availability, and resiliency is vital and the subject of many research and engineering efforts. Still, a major roadblock hinders researchers: dearth of reliable data describing the behavior of production supercomputers. In this paper, we present the result of a ten-year-long project to design a monitoring framework (EXAMON) deployed at the Italian supercomputers at CINECA datacenter. We disclose the first holistic dataset of a tier-0 Top10 supercomputer. It includes the management, workload, facility, and infrastructure data of the Marconi100 supercomputer for two and half years of operation. The dataset (published via Zenodo) is the largest ever made public, with a size of 49.9TB before compression. We also provide open-source software modules to simplify access to the data and provide direct usage examples.
Permanent link
Publication status
published
External links
Editor
Book title
Journal / series
Volume
10
Pages / Article No.
288
Publisher
Nature
Event
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
Computer science; Information technology
Organisational unit
03996 - Benini, Luca / Benini, Luca