Suicide and self-harm in the age of generative artificial intelligence: The case of ChatGPT and rise of suicide-related lawsuits.

Self-harm and suicide trends have taken a new turn in the era of GenAI and communicative chatbots. Recent OpenAI's own report suggests that 1.2 million weekly ChatGPT users appear to be expressing suicidal thoughts, and 80,000 users are potentially experiencing mania and psychosis. At the same time, OpenAI and other AI companies are facing lawsuits in several countries alleging that their chatbots encouraged vulnerable individuals to harm themselves. These lawsuits have sparked a growing scholarly debate about responsibility, safety, and the ethical use of chatbots in mental health services. GenAI can offer timely informational support and help identify suicide risk factors; it also presents significant risks, including the potential to amplify existing vulnerabilities and its inability to provide sustained care. Suicide prevention efforts now face novel challenges, with users, families, mental health professionals, psychiatrists, clinicians, and technology companies struggling to navigate rapidly evolving AI-mediated care. This article contended that researchers and clinicians should be cautious about the promises and pitfalls of GenAI around mental health support. We also discussed key considerations for designing and implementing ethical AI systems to strengthen transparency and regulations to develop humane technology that empowers users, families, and clinicians in promoting mental wellbeing.