人工智能聊天机器人因未成年人(包括一名自杀青少年)与缺乏适当防护的高风险AI角色互动而受到审查。
AI chatbots faced scrutiny after minors, including a teen who died by suicide, interacted with risky AI personas lacking adequate safeguards.
在家庭报告称这些平台允许与未成年人进行掠夺性互动且未能回应自杀威胁后,角色AI聊天机器人正受到越来越多的关注。
Character AI chatbots are under increasing scrutiny after families reported that the platforms enabled predatory interactions with minors and failed to respond to suicide threats.
包括一名因自杀而死亡的13岁女孩, 与模仿同龄人或浪漫伴侣的AI人员接触,
Parents say teens, including a 13-year-old girl who died by suicide, engaged with AI personas that mimicked peers or romantic partners, sharing distressing thoughts without intervention.
尽管采取了一些安全措施,但专家和倡导者强调年龄核查不力、内容调适不足和对有害内容反应不足。
Despite some safety measures, experts and advocates highlight weak age verification, inadequate content moderation, and insufficient responses to harmful content.
随着对影响青年心理健康的未经监测的数字互动的担忧增加,这一案件促使人们呼吁在开发AI方面加强监管和问责制。
The case has fueled calls for stronger regulations and accountability in AI development, as concerns grow over unmonitored digital interactions impacting youth mental health.