Hierarchical priors for Bayesian CART shrinkage

  • Authors:
  • Hugh Chipman;Robert E. McCulloch

  • Affiliations:
  • Department of Statistics and Actuarial Science, University of Waterloo, Waterloo, ON N2L 3G1. hachipman@uwaterloo.ca;-

  • Venue:
  • Statistics and Computing
  • Year:
  • 2000

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Bayesian CART (classification and regression tree) approachproposed by Chipman, George and McCulloch (1998) entails putting aprior distribution on the set of all CART models and then usingstochastic search to select a model. The main thrust of this paper isto propose a new class of hierarchical priors which enhance thepotential of this Bayesian approach. These priors indicate apreference for smooth local mean structure, resulting in tree models whichshrink predictions from adjacent terminal node towards each other.Past methods for tree shrinkage have searched for trees without shrinking,and applied shrinkage to the identified tree only after the search.By using hierarchical priors in the stochastic search, the proposedmethod searches for shrunk trees that fit well and improvesthe tree through shrinkage of predictions.