Repository logo
 

Model-based and model-free pain avoidance learning

Published version
Peer-reviewed

Type

Article

Change log

Authors

Wang, Oliver 
Lee, Sangwan 
O'Doherty, John 
Seymour, BJ 
Yoshida, Wako 

Abstract

Whilst there is good evidence that reward learning is underpinned by two distinct decision control systems - a cognitive ‘model-based’ and a habit-based ‘model-free’ system, a comparable distinction for punishment avoidance has been much less clear. We implemented a pain avoidance task that placed differential emphasis on putative model-based and model-free processing, mirroring a paradigm and modelling approach recently developed for reward-based decision-making. Subjects performed a two-step decision-making task with probabilistic pain outcomes of different quantities. The delivery of outcomes was sometimes contingent on a rule signalled at the beginning of each trial, emulating a form of outcome devaluation. The behavioural data showed that subjects tended to use a mixed strategy - favouring the simpler model-free learning strategy when outcomes did not depend on the rule, and favouring a model-based when they did. Furthermore, the data was well described by a dynamic transition model between the two controllers. When compared to data from a reward-based task (albeit tested in the context of the scanner), we observed that avoidance involved a significantly greater tendency for subjects to switch between model-free and model-based systems in the face of changes in uncertainty. Our study suggests a dual-system model of pain avoidance, similar to but possibly more dynamically flexible than reward-based decision-making.

Description

Keywords

decision making, pain avoidance, reinforcement learning, uncertainty

Journal Title

Brain and Neuroscience Advances

Conference Name

Journal ISSN

2398-2128
2398-2128

Volume Title

2

Publisher

SAGE Publications
Sponsorship
Arthritis Research UK (21537)
Arthritis Research UK (Ref: 21357).