Martin J. Green
Use of posterior predictive assessments to evaluate model fit in multilevel logistic regression
Green, Martin J.; Medley, Graham F.; Browne, William J.
Authors
Graham F. Medley
William J. Browne
Abstract
Assessing the fit of a model is an important final step in any statistical analysis, but this is not straightforward when complex discrete response models are used. Cross validation and posterior predictions have been suggested as methods to aid model criticism. In this paper a comparison is made between four methods of model predictive assessment in the context of a three level logistic regression model for clinical mastitis in dairy cattle; cross validation, a prediction using the full posterior predictive distribution and two “mixed” predictive methods that incorporate higher level random effects simulated from the underlying model distribution. Cross validation is considered a gold standard method but is computationally intensive and thus a comparison is made between posterior predictive assessments and cross validation. The analyses revealed that mixed prediction methods produced results close to cross validation whilst the full posterior predictive assessment gave predictions that were over-optimistic (closer to the observed disease rates) compared with cross validation. A mixed prediction method that simulated random effects from both higher levels was best at identifying the outlying level two (farm-year) units of interest. It is concluded that this mixed prediction method, simulating random effects from both higher levels, is straightforward and may be of value in model criticism of multilevel logistic regression, a technique commonly used for animal health data with a hierarchical structure.
Citation
Green, M. J., Medley, G. F., & Browne, W. J. (2009). Use of posterior predictive assessments to evaluate model fit in multilevel logistic regression. Veterinary Research, 40(4), Article Article 30. https://doi.org/10.1051/vetres/2009013
Journal Article Type | Article |
---|---|
Publication Date | Jan 1, 2009 |
Deposit Date | Apr 19, 2010 |
Publicly Available Date | Apr 19, 2010 |
Journal | Veterinary Research |
Print ISSN | 0928-4249 |
Electronic ISSN | 1297-9716 |
Publisher | Springer Verlag |
Peer Reviewed | Peer Reviewed |
Volume | 40 |
Issue | 4 |
Article Number | Article 30 |
DOI | https://doi.org/10.1051/vetres/2009013 |
Keywords | model fit, posterior predictive assessment, mixed predictive assessment, cross validation, Bayesian multilevel model |
Public URL | https://nottingham-repository.worktribe.com/output/1014474 |
Publisher URL | http://dx.doi.org/10.1051/vetres/2009013 |
Files
Posterior_prediction_paper_in_Vet_Res.pdf
(230 Kb)
PDF
You might also like
Systematic biases in early ERP and ERF components as a result of high-pass filtering
(2012)
Journal Article
Small area synthetic estimates of smoking prevalence during pregnancy in England
(2015)
Journal Article
Downloadable Citations
About Repository@Nottingham
Administrator e-mail: discovery-access-systems@nottingham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search