- Conference Paper
We present a randomized benchmark generator for attesting the correctness and performance of online first-order monitors. The benchmark generator consists of three components: a stream generator, a stream replayer, and a monitoring oracle. The stream generator produces random event streams that conform to user-defined characteristics such as event frequencies and distributions of the events’ parameters. The stream replayer reproduces event streams in real time at a user-defined velocity. By varying the stream characteristics and velocity, one can analyze their impact on the monitor’s performance. The monitoring oracle provides the expected result of monitoring the generated streams against metric first-order regular specifications. The specification languages supported by most existing monitors are either a subset of or share a large common fragment with the oracle’s language. Thus, we envision that our benchmark generator will be used as a standard correctness and performance testing tool for online monitors. Show more
Book titleRuntime Verification
Journal / seriesLecture Notes in Computer Science
Pages / Article No.
SubjectOnline monitoring; Temporal logic; Benchmark
Organisational unit03634 - Basin, David / Basin, David
167162 - Big Data Monitoring (SNF)
NotesDue to the Coronavirus (COVID-19) the conference was conducted virtually.
MoreShow all metadata