Size matters
The use and misuse of statistical significance in discrete choice models in the transportation academic literature
OPEN ACCESS
Loading...
Author / Producer
Date
2022-08-13
Publication Type
Working Paper
ETH Bibliography
yes
Citations
Altmetric
OPEN ACCESS
Data
Rights / License
Abstract
In this paper we review the academic transportation literature published between 2014 and 2018 to evaluate where the field stands regarding the use and misuse of statistical significance in empirical analysis, with a focus on discrete choice models. Our results show that 39% of studies explained model results exclusively based on the sign of the coefficient, 67% of studies did not distinguish statistical significance from economic, policy or scientific significance in their conclusions, and none of the reviewed studies considered the statistical power of the tests. Based on these results we put forth a set of recommendations aimed at shifting the focus away from statistical significance towards proper and comprehensive assessment of effect magnitudes and other policy relevant quantities.
Permanent link
Publication status
published
Editor
Book title
Journal / series
Volume
Pages / Article No.
2208.06543
Publisher
Cornell University
Event
Edition / version
1
Methods
Software
Geographic location
Date collected
Date created
Subject
Discrete choice models; Effect size; Statistical significance; Statistical power; Policy and practice implications
Organisational unit
03521 - Axhausen, Kay W. (emeritus) / Axhausen, Kay W. (emeritus)
02655 - Netzwerk Stadt u. Landschaft ARCH u BAUG / Network City and Landscape ARCH and BAUG
Notes
Funding: JSPS KAKENHI Grants Number 20H02266
Funding
Related publications and datasets
Is previous version of: http://hdl.handle.net/20.500.11850/573797
Is previous version of: https://doi.org/10.3929/ethz-b-000636311