Meta has unveiled a new set of safety measures aimed at protecting teenagers using its AI tools, including a feature that alerts parents if conversations with Meta AI suggest a teen may be at risk of suicide or self-harm.
The new “Parent Alerts” feature will begin rolling out on Thursday for parents using Instagram’s parental supervision tools in the United States, the United Kingdom, Australia and Canada. Meta said the feature will be expanded globally by the end of 2026.
Also Read | Microsoft’s silent room is so quiet it can affect your mind
According to the company, parents who receive an alert will also be provided with expert-backed guidance to help them discuss mental health concerns with their children.
How will Meta’s new AI safety system work?
Meta said it has developed a dedicated AI system to identify high-risk conversations after consulting parents and mental health professionals about the types of interactions that should trigger alerts.
The company stressed that every conversation flagged by AI will undergo review by a human before any notification is sent to parents.
Meta added that when a teen’s intent is unclear, the system will “err on the side of caution.”
The company also announced it is developing a feature that will allow it to contact first responders if conversations suggest someone faces an imminent risk of suicide. Meta said the initiative builds on more than 19,000 emergency referrals made globally through Facebook and Instagram last year.
What other protections are being introduced?
Meta said all users under the age of 18 are automatically placed in a teen account experience, which also applies to conversations with Meta AI.
The company has also expanded Instagram’s “Limited Content” setting to Meta AI. Parents who enable stricter supervision settings will automatically restrict the type of AI interactions available to their teenagers.
To improve AI responses to prompts involving suicide or self-harm, Meta said it worked with clinicians specialising in adolescent mental health and sought guidance from its AI Wellbeing Expert Council, Suicide and Self-Harm Advisory Group, and Youth Advisors.
The announcement comes as technology companies continue strengthening safeguards for younger users. OpenAI already offers parental controls and additional protections for ChatGPT users under 18, while Anthropic says its AI assistant Claude is intended only for users aged 18 and above.
Also Read | Galaxy Z Fold 8: New Spider-Man promo reveals design hint
Meta’s latest update also follows increased scrutiny of its AI products, including criticism over AI image-generation features and a recent lawsuit alleging AI-assisted decisions during workforce layoffs. The company has denied those allegations.
FAQs
Q1. What is Meta’s new Parent Alerts feature?
The feature notifies parents if Meta AI detects conversations that may indicate a teen is considering suicide or self-harm. Every flagged conversation is reviewed by a human before an alert is sent.
Q2. Where is Meta rolling out the new teen safety feature first?
The feature is initially launching in the United States, the United Kingdom, Australia and Canada, with a global rollout planned by the end of 2026.
