Skip to content
Research Article Open access CC BY 4.0

Frequentist Approximation of the Bayesian Posterior Inclusion Probability by Stochastic Subsampling

V. Ly, E. Fokoué

Journal of Advances in Mathematics and Computer Science · pp. 1–22 · Published 16 Sep 2016

10.9734/BJMCS/2016/27023

Abstract

This paper uses stochastic subsampling of the dataset to provide a frequentist approximation to what is known in the Bayesian framework as the posterior inclusion probability (PIP). The distinct merit of this contribution lies in the fact that it makes it easier for typically non-Bayesian-minded practitioners, of which there are many, to relate to the way the Bayesian paradigm allows the computation of the nicely interpretable variable importance. Despite its computationally intensive nature, due to the need to fitting a very large number of models, the proposed approach is readily applicable to both classification and regression tasks, and can be done in comparatively competitive computational times thanks to the availability of parallel computing facilities through cloud and cluster computing. Finally, the scheme proposed is very general and can therefore be easily adapted to all kinds of statistical prediction tasks. Application of the proposed method to some very famous benchmark datasets shows that it mimics the Bayesian counterpart quite well in the important context of variable selection.

Generalized linear model bayesian variable selection posterior inclusion probability stochastic subsampling binary classification prediction logistic logit probit Cauchit

References (5)

  1. 1 UCI Machine Learning Repository
  2. 2 (1) OPTIMAL PREDICTIVE MODEL SELECTION 1
  3. 3 Spam Filtering Based On The Analysis Of Text Information Embedded Into Images
  4. 4 GENERALIZED BODY COMPOSITION PREDICTION EQUATION FOR MEN USING SIMPLE MEASUREMENT TECHNIQUES [DOI]
  5. 5 Adaptive Approach for Spam Detection

Cited by 4

Nanotheoretical returns and Stochastic Modeling in Nanofinance: Economic Implications for Informal, Unregulated Markets

Taoer Yang, R. G. Martinez · Computational Economics · 2025

Detecting gene–gene interactions from GWAS using diffusion kernel principal components

Andrew Walakira, Junior Ocira, Diane Duroux · BMC Bioinformatics · 2022

Evolutionary Weights for Random Subspace Learning

Andrey Ramos · 2016

Showing 3 of 4 known citations — external sources report more than can currently be individually listed.

Related research

Article metrics

Real usage data collected on this platform.

30

Page views

0

PDF downloads

2

Outbound clicks

4

Citations

Views over time

Views by country

Approximate, from request IP at view time — not citizenship or institution. Countries with fewer than 5 views are grouped as "Other".

Traffic sources

Referring site, by host.

Views and downloads exclude known bots/crawlers. Citations combines this platform's own DOI-resolved index with each external source's own reported total — see Cited by above for individually listed citing works. Last refreshed 0 seconds ago.