Computational modeling is gaining increasing popularity in the field of psychiatry. By applying a machine learning framework known as reinforcement learning (RL), researchers in the domain of computational psychiatry have begun to shed light on the latent decision-making processes that are altered in mental disorders. In this chapter, we first explain how RL can be used to characterize the neurocomputational processes of decision-making and learning. To illustrate this approach, we focus on a set of studies that employ a basic class of RL, known as model-free RL, to gain insights into the psychopathology of obsessive–compulsive and gambling disorders. Lastly, we review a common model-fitting procedure used in computational psychiatry research and offer a practical guide, also considering potential pitfalls. This encompasses discussions on estimating model parameters (parameter estimation), comparing multiple models based on their goodness of fits (model comparison), and testing the robustness of model-fitting procedures using synthesized data (model and parameter recovery analyses). Given the rapid growth of this area of study, we believe that these discussions will be of great value to authors, reviewers, and readers of computational psychiatry literature.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Applying Reinforcement Learning to the Psychopathology of Obsessive–Compulsive and Gambling Disorders: Practices and Pitfalls in Computational Model Fitting

  • Shinsuke Suzuki,
  • Kentaro Katahira

摘要

Computational modeling is gaining increasing popularity in the field of psychiatry. By applying a machine learning framework known as reinforcement learning (RL), researchers in the domain of computational psychiatry have begun to shed light on the latent decision-making processes that are altered in mental disorders. In this chapter, we first explain how RL can be used to characterize the neurocomputational processes of decision-making and learning. To illustrate this approach, we focus on a set of studies that employ a basic class of RL, known as model-free RL, to gain insights into the psychopathology of obsessive–compulsive and gambling disorders. Lastly, we review a common model-fitting procedure used in computational psychiatry research and offer a practical guide, also considering potential pitfalls. This encompasses discussions on estimating model parameters (parameter estimation), comparing multiple models based on their goodness of fits (model comparison), and testing the robustness of model-fitting procedures using synthesized data (model and parameter recovery analyses). Given the rapid growth of this area of study, we believe that these discussions will be of great value to authors, reviewers, and readers of computational psychiatry literature.