SoundsRide: Affordance-Synchronized Music Mixing for In-Car Audio Augmented Reality
METADATA ONLY
Author / Producer
Date
2021-10
Publication Type
Conference Paper
ETH Bibliography
yes
Citations
Altmetric
METADATA ONLY
Data
Rights / License
Abstract
Music is a central instrument in video gaming to attune a player's attention to the current atmosphere and increase their immersion in the game. We transfer the idea of scene-adaptive music to car drives and propose SoundsRide, an in-car audio augmented reality system that mixes music in real-time synchronized with sound affordances along the ride. After exploring the design space of affordance-synchronized music, we design SoundsRide to temporally and spatially align high-contrast events on the route, e. g., highway entrances or tunnel exits, with high-contrast events in music, e. g., song transitions or beat drops, for any recorded and annotated GPS trajectory by a three-step procedure. In real-time, SoundsRide 1) estimates temporal distances to events on the route, 2) fuses these novel estimates with previous estimates in a cost-aware music-mixing plan, and 3) if necessary, re-computes an updated mix to be propagated to the audio output. To minimize user-noticeable updates to the mix, SoundsRide fuses new distance information with a filtering procedure that chooses the best updating strategy given the last music-mixing plan, the novel distance estimations, and the system parameterization. We technically evaluate SoundsRide and conduct a user evaluation with 8 participants to gain insights into how users perceive SoundsRide in terms of mixing, affordances, and synchronicity. We find that SoundsRide can create captivating music experiences and positively as well as negatively influence subjectively perceived driving safety, depending on the mix and user.
Permanent link
Publication status
published
External links
Book title
The 34th Annual ACM Symposium on User Interface Software and Technology (UIST ’21)
Journal / series
Volume
Pages / Article No.
118 - 133
Publisher
Association for Computing Machinery
Event
34th Annual ACM Symposium on User Interface Software and Technology (UIST 2021)
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
Auditory augmentd reality; Sound affordances; Context adaptive music
Organisational unit
09649 - Holz, Christian / Holz, Christian