Skip to main content

Research Repository

Advanced Search

Levels of Evidence, Quality Assessment, and Risk of Bias: Evaluating the Internal Validity of Primary Research

Sargeant, Jan M.; Brennan, Marnie L.; O'Connor, Annette M.

Levels of Evidence, Quality Assessment, and Risk of Bias: Evaluating the Internal Validity of Primary Research Thumbnail


Authors

Jan M. Sargeant

Annette M. O'Connor



Abstract

Clinical decisions in human and veterinary medicine should be based on the best available evidence. The results of primary research are an important component of that evidence base. Regardless of whether assessing studies for clinical case management, developing clinical practice guidelines, or performing systematic reviews, evidence from primary research should be evaluated for internal validity i.e., whether the results are free from bias (reflect the truth). Three broad approaches to evaluating internal validity are available: evaluating the potential for bias in a body of literature based on the study designs employed (levels of evidence), evaluating whether key study design features associated with the potential for bias were employed (quality assessment), and applying a judgement as to whether design elements of a study were likely to result in biased results given the specific context of the study (risk of bias assessment). The level of evidence framework for assessing internal validity assumes that internal validity can be determined based on the study design alone, and thus makes the strongest assumptions. Risk of bias assessments involve an evaluation of the potential for bias in the context of a specific study, and thus involve the least assumptions about internal validity. Quality assessment sits somewhere between the assumptions of these two. Because risk of bias assessment involves the least assumptions, this approach should be used to assess internal validity where possible. However, risk of bias instruments are not available for all study designs, some clinical questions may be addressed using multiple study designs, and some instruments that include an evaluation of internal validity also include additional components (e.g., evaluation of comprehensiveness of reporting, assessments of feasibility or an evaluation of external validity). Therefore, it may be necessary to embed questions related to risk of bias within existing quality assessment instruments. In this article, we overview the approaches to evaluating internal validity, highlight the current complexities, and propose ideas for approaching assessments of internal validity.

Citation

Sargeant, J. M., Brennan, M. L., & O'Connor, A. M. (2022). Levels of Evidence, Quality Assessment, and Risk of Bias: Evaluating the Internal Validity of Primary Research. Frontiers in Veterinary Science, 9, Article 960957. https://doi.org/10.3389/fvets.2022.960957

Journal Article Type Article
Acceptance Date Jun 24, 2022
Online Publication Date Jul 12, 2022
Publication Date Jul 12, 2022
Deposit Date Nov 25, 2022
Publicly Available Date Mar 29, 2024
Journal Frontiers in Veterinary Science
Print ISSN 2297-1769
Electronic ISSN 2297-1769
Publisher Frontiers Media SA
Peer Reviewed Peer Reviewed
Volume 9
Article Number 960957
DOI https://doi.org/10.3389/fvets.2022.960957
Keywords confounding, bias, evidence-based medicine, veterinary, internal validity, critical appraisal, general veterinary
Public URL https://nottingham-repository.worktribe.com/output/10072875
Publisher URL https://www.frontiersin.org/articles/10.3389/fvets.2022.960957/full
Additional Information Received: 03 June 2022; Accepted: 24 June 2022; Published: 12 July 2022.

Files




You might also like



Downloadable Citations