AI Companions for Health and Mental Wellbeing: Opportunities, Risks and Policy Implications

Abstract

Advancements in generative and conversational AI have introduced powerful tools that engage users through intuitive, conversation-based interfaces. These systems are increasingly being positioned as solutions to complex societal challenges, particularly in mental wellbeing and loneliness. Termed ‘Social AI,’ these technologies focus on meeting users’ social needs—such as companionship, communication, and emotional support—and show promise in addressing issues like overburdened healthcare systems and limited access to mental health care. While promising, Social AI also raises significant ethical and practical concerns, including the potential for user manipulation or the unintended development of dependencies, potentially exacerbating the issues these systems aim to solve. To address these opportunities and risks, the Social AI Policy Futures Workshop was convened in August 2024 at Jesus College, Cambridge. This interdisciplinary event brought together over fifty experts, including researchers, technologists, and healthcare professionals, to explore the implications of Social AI. The outcomes of the workshop are detailed in this report. The risks and benefits of Social AI for health and healthcare, as well as mental health and wellbeing discussed by the workshop participants are highlighted below, followed by a summary of policy recommendations put forward by the experts.