Multiple statistical tests: Lessons from a d20

Madan, Christopher R.

Abstract

Statistical analyses are often conducted with α= .05. When multiple statistical tests are conducted, this procedure needs to be adjusted to compensate for the otherwise inflated Type I error. In some instances in tabletop gaming, sometimes it is desired to roll a 20-sided die (or 'd20') twice and take the greater outcome. Here I draw from probability theory and the case of a d20, where the probability of obtaining any specific outcome is 1/20, to determine the probability of obtaining a specific outcome (Type-I error) at least once across repeated, independent statistical tests.

Citation

Madan, C. R. (2016). Multiple statistical tests: Lessons from a d20. F1000Research, 5, Article 1129. https://doi.org/10.12688/f1000research.8834.2

• Journal Article Type: Article
• Acceptance Date: Jul 5, 2016
• Online Publication Date: Sep 7, 2016
• Publication Date: Jun 2, 2016
• Deposit Date: Oct 13, 2020
• Publicly Available Date: Mar 10, 2021
• Journal: F1000Research
• Electronic ISSN: 2046-1402
• Publisher: F1000Research
• Peer Reviewed: Peer Reviewed
• Volume: 5
• Article Number: 1129
• DOI: https://doi.org/10.12688/f1000research.8834.2
• Public URL: https://nottingham-repository.worktribe.com/output/4930389
• Publisher URL: https://f1000research.com/articles/5-1129/v2
• Additional Information: Referee status: Indexed; Referee Report: 10.5256/f1000research.10322.r16168, Jens Foell, Department of Psychology, Florida State University, Tallahassee, FL, USA, 07 Sep 2016, version 2, indexed; Referee Report: 10.5256/f1000research.9509.r14150, Matthew Wall, Division of Brain Sciences, Imperial College London, London, UK, 08 Jun 2016, version 1, indexed; Referee Report: 10.5256/f1000research.9509.r14147, Steven R Shaw, Department of Educational and Counselling Psychology (ECP), McGill University, Montreal, QC, Canada, 05 Jul 2016, version 1, indexed; Grant Information: The author(s) declared that no grants were involved in supporting this work; Copyright: This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.