Counterfactual reasoning underlies the learning of priors in decision making
View / Open Files
Publication Date
2017-11-30ISSN
0896-6273
Publisher
Elsevier
Type
Article
This Version
VoR
Metadata
Show full item recordCitation
Zylberberg, A., Wolpert, D., & Shadlen, M. (2017). Counterfactual reasoning underlies the learning of priors in decision making. https://doi.org/10.1101/227421
Abstract
Accurate decisions require knowledge of prior probabilities (e.g., prevalence or base rate) but it is unclear how prior probability is learned in the absence of a teacher. We hypothesized that humans could learn base rates from experience making decisions, even without feedback. Participants made difficult decisions about the direction of dynamic random dot motion. For each block of 15-42 trials, the base rate favored left or right by a different amount. Participants were not informed of the base rate, yet they gradually biased their choices and thereby increased accuracy and confidence in their decisions. They achieved this by updating knowledge of base rate after each decision, using a counterfactual representation of confidence that simulates a neutral prior. The strategy is consistent with Bayesian updating of belief and suggests that humans represent both true confidence, that incorporates the evolving belief of the prior, and counterfactual confidence that discounts the prior.
Identifiers
External DOI: https://doi.org/10.1101/227421
This record's URL: https://www.repository.cam.ac.uk/handle/1810/288927