Hierarchical Bayesian modeling: Does it improve parameter stability? (2013)

Abstract

Fitting multi-parameter models to the behavior of individual participants is a popular approach in cognitive science to measuring individual differences. This approach assumes that the model parameters capture psychologically meaningful and stable characteristics of a person. If so, the estimated parameters should show, to some extent, stability across time. Recently, it has been proposed that hierarchical procedures might provide more reliable parameter estimates than non- hierarchical procedures. Here, we examine the benefits of hierarchical parameter estimation for assessing parameter stability using Bayesian tec hniques. Using the transfer-of- attention-exchange model (TAX; Birnbaum & Chavez, 1997), a highly successful account of risky decision making, we compare parameter stability based on hierarchically versus non-hierarchically es timated parameters. Surprisingly, we find that parameter stability for TAX is not improved by using a hierarchical Bayesian as compared to a non- hierarchical Bayesian approach. Further analyses suggest that this is because the shrinkage induced by hierarchical estimation overcorrects for extreme yet reliable parameter values. We suggest that the benefits of hierarchical techniques may be limited to particular conditions, such as sparse data on the individual level or very homogenous samples.

Bibliographic entry

Scheibehenne, B., & Pachur, T. (2013). Hierarchical Bayesian modeling: Does it improve parameter stability? In M. Knauff, M. Pauen, N. Sebanz, & I. Wachsmuth (Eds.), Cooperative minds: Social interaction and group dynamics. Proceedings of the 35th Annual Conference of the Cognitive Science Society (pp. 1277-1282). Austin, TX: Cognitive Science Society. (Full text)

Miscellaneous

Publication year 2013
Document type: In book
Publication status: Published
External URL: http://mindmodeling.org/cogsci2013/papers/0244/paper0244.pdf View
Categories:
Keywords: choicecognitive modelinghierarchical bayesian modelingparameter consistencyriskytransfer-of-attention-

Edit | Publications overview