The design, experiment, analyse, and reproduce principle for experimentation in virtual reality


Author / Producer

Date

2023-04-12

Publication Type

Journal Article

ETH Bibliography

yes

Citations

Altmetric

Data

Abstract

Conducting experiments in virtual reality (VR) requires a complex setup of hardware, software, experiment design and implementation, and data collection which is supported by frameworks that provide pre-determined features for scientists to implement their experiment in VR. These VR frameworks have proliferated exponentially since the start of the millennia, and unfortunately, they both only differ slightly from one another and often miss one or more of the key features required by the researcher. Therefore, it has become less clear to researchers which framework to choose for what task and to what benefit. I introduce the design, experiment, analyse, and reproduce (DEAR) principle to develop a new perspective on VR frameworks through a holistic approach to experimentation (i.e., the process of conducting an experiment). The DEAR principle lays out the core components that future frameworks should entail. Most previous VR frameworks have focussed on the design phase and sometimes on the experiment phase to help researchers create and conduct experiments. However, being able to create an experiment with a framework is not sufficient for wide adoption. Ultimately, I argue that it is important to take reproducibility seriously to overcome the limitations of current frameworks. Once experiments are fully reproducible through automation, the adaptation of new experiments becomes easier. Hopefully, researchers can find ways to converge in the use of frameworks or else frameworks may become a hindrance instead of a help.

Publication status

published

Editor

Book title

Volume

4

Pages / Article No.

1069423

Publisher

Frontiers Media

Event

Edition / version

Methods

Software

Geographic location

Date collected

Date created

Subject

virtual reality; digital twin; framework; reproducibility; experiments; experimentation

Organisational unit

03901 - Raubal, Martin / Raubal, Martin check_circle
03987 - Hölscher, Christoph / Hölscher, Christoph check_circle
02261 - Center for Sustainable Future Mobility / Center for Sustainable Future Mobility
08698 - Game Technology Center (GTC)

Notes

JG was supported by the ETH Doc.Mobility fellowship.
Perspective.

Funding

ETH-15 16-2 - A Cognitive Science Approach to Evidence-Based Design Using Virtual Reality (ETHZ)

Related publications and datasets