First three years of the international verification of neural networks competition (VNN-COMP)


Loading...

Date

2023-06

Publication Type

Journal Article

ETH Bibliography

yes

Citations

Altmetric

Data

Abstract

This paper presents a summary and meta-analysis of the first three iterations of the annual International Verification of Neural Networks Competition (VNN-COMP), held in 2020, 2021, and 2022. In the VNN-COMP, participants submit software tools that analyze whether given neural networks satisfy specifications describing their input-output behavior. These neural networks and specifications cover a variety of problem classes and tasks, corresponding to safety and robustness properties in image classification, neural control, reinforcement learning, and autonomous systems. We summarize the key processes, rules, and results, present trends observed over the last three years, and provide an outlook into possible future developments.

Publication status

published

Editor

Book title

Volume

25 (3)

Pages / Article No.

329 - 339

Publisher

Springer

Event

Edition / version

Methods

Software

Geographic location

Date collected

Date created

Subject

Certified robustness; Adversarial robustness; Formal verification; Formal methods; Neural networks; Machine learning; Deep learning

Organisational unit

Notes

Funding

Related publications and datasets