Meta has introduced new features to notify parents when their teenagers discuss suicide or self-harm with the company’s chatbot, Meta AI. If parents have enabled the supervision option for their teens on Instagram, they will receive alerts on their own devices if a teenage user displays signs of distress while interacting with Meta AI on any Meta platform. The new measures expand on Meta’s existing safety protocols, where previously, when a teenager indicated thoughts of self-harm or suicide, the AI chatbot would guide them to crisis helplines and prompt them to contact a trusted individual. Additionally, repeated searches related to self-harm and suicide by teenage Instagram users trigger notifications to parents. Meta, the parent company of Instagram and Facebook, has rolled out this feature in Canada, the U.K., the U.S., and Australia.
Moreover, Meta is developing a tool to automatically contact emergency services if conversations with the chatbot, involving both adults and teens, suggest potential self-harm. While stakeholders view these initiatives positively, they emphasize the need for further enhancements. Technology analyst Carmi Levy remarks that although these tools are beneficial, they are not foolproof and may generate false alarms or miss genuine risks. Meta plans to err on the side of caution initially, notifying parents even when a teenager’s intentions are unclear.
In response to these developments, youth advocate Hanna Grover notes the possibility of adolescents circumventing the system, citing instances where peers falsified their birthdates to avoid using teen accounts that offer heightened security features. Children First Canada’s founder and CEO, Sara Austin, stresses the inadequacy of voluntary measures and calls for stricter regulations to safeguard young individuals. She advocates for legislative measures like the Safe Social Media Act, introduced by the Canadian government in June, which mandates safety standards for AI chatbots in situations involving self-harm or suicidal ideation.
The introduction of Meta’s new tool coincides with increased scrutiny on the role of AI during mental health crises among young people. Recent incidents involving OpenAI, such as the Tumbler Ridge mass shooting and the tragedy of teenager Adam Raine, have underscored the importance of effective monitoring and intervention in digital spaces. OpenAI has since implemented parental controls and alerts akin to Meta’s features to enhance safety for users.
As the digital landscape evolves, experts stress the importance of continuous monitoring and regulatory measures to protect vulnerable individuals. While advancements in AI technology offer promising solutions, the ongoing dialogue on digital safety and mental health remains critical.