65th ISI World Statistics Congress 2025

65th ISI World Statistics Congress 2025

Microbial diversity estimation and Hill number calculation using the hierarchical Pitman-Yor process

Conference

65th ISI World Statistics Congress 2025

Format: IPS Abstract - WSC 2025

Keywords: bayesian hierarchical model, microbiome

Session: IPS 733 - Bayesian Model Based Methods with Applications

Tuesday 7 October 2 p.m. - 3:40 p.m. (Europe/Amsterdam)

Abstract

The human microbiome comprises the microorganisms that inhabit the various locales of the human body and plays a vital role in human health. The composition of a microbial population is often quantified through measures of species diversity, which summarize the number of species along with their relative abundances into a single value. In a microbiome sample there will certainly be species missing from the target population which will affect the diversity estimates. We employ a model based on the hierarchical Pitman-Yor (HPY) process (Battiston et al. 2018) to model the species abundance distributions over multiple microbiome populations. The model parameters are estimated using a Gibbs sampler. We also show how estimates of true population diversity can be obtained as a function of the HPY parameters, and that the estimates from the HPY model improve over naive estimates. Finally, we run the HPY procedure on an infant gut microbiome dataset from the Canadian Healthy Infant Longitudinal Development (CHILD) cohort study.