Bayesian generalized additive model selection
- Publication Type:
- Thesis
- Issue Date:
- 2025
Open Access
Copyright Clearance Process
- Recently Added
- In Progress
- Open Access
This item is open access.
Generalized additive models (GAMs) offer a parsimonious, flexible and interpretable framework for regression, particularly when handling a large numbers of candidate predictors. This thesis addresses the GAM variable selection problem: categorizing each candidate predictor's effect type to be linear, non-linear or zero on the mean response. We use Bayesian model selection paradigms and group least absolute shrinkage and selection operator (LASSO) priors. Two types of priors are explored for the sparse fits. The first, Laplace-Zero and Grouped Lasso-Zero priors, is applied to Gaussian and binary responses. The second, (Grouped) Horseshoe priors, is used for Gaussian and count responses. For both prior types, tailored auxiliary variable representations enable the Markov chain Monte Carlo (MCMC) sampling reduce to the Gibbs sampling or to slice sampling. To improve computational scalability and speed, we also derive the mean field variational Bayes (MFVB) algorithms under the Laplace-Zero and Grouped Lasso-Zero priors. The GAM selection framework is further extended to generalized additive mixed model (GAMM) with random intercept. Finally, the properties of the Grouped Horseshoe distribution and its use in Bayesian GAM selection are investigated. While many characteristics of univariate Horseshoe distribution are carried over, some distinctions arise in the grouped case.
Please use this identifier to cite or link to this item:
