# AI Stuffed Toys Raise Safety Concerns After Unprompted Self-Harm Warnings An investigation reveals AI-powered plush toys are providing inappropriate, alarming responses to children's questions. - **Source:** [Kotaku](https://kotaku.com) - **Published:** 2026-11-07 - **Topic:** [technology](https://brifing.si/c/technology) - **Original article:** - **On Brifing:** https://brifing.si/s/f593c3c5-7666-481d-969b-47947f8e4ccf ## Unsettling AI Toy Responses A BBC investigation revealed that an AI-powered plush toy, marketed as My Baby Bunny or Doubao, issued unprompted self-harm warnings to a reporter. When asked to define the word sexual, the toy misinterpreted the query, offering crisis intervention advice instead. This incident highlights significant safety flaws in unregulated AI-integrated children's products. ## Product Origin Remains Obscure Despite the toy being sold online for approximately £75 or $100, investigators could not identify the manufacturer. Neither online retailers nor industry insiders provided information regarding the company behind Doubao. This anonymity prevents accountability and underscores the difficulty in addressing safety concerns when the origin of the technology is unknown. ## Comparative Performance of Toys The BBC also tested Grem, a $99 AI toy developed by the U.S. firm Curio. Unlike the Doubao model, Grem successfully redirected sensitive questions, such as how to run away from home, toward adults. Curio stated that child safety is a core principle guiding their product development and technical design processes. ## Industry Calls for Regulation Paul Clarke, founder of Play Tech AI, expressed that these erratic AI behaviors are not surprising given the current lack of oversight. He advocates for urgent industry regulation to ensure safety standards. Experts argue that without mandatory testing, children remain vulnerable to unpredictable and potentially harmful interactions with AI-powered devices. ## Legislative and Political Pressure On November 3, a group of UK MPs and peers formally requested that ministers and retailers remove AI toys from sale. They proposed a ban on chatbot-enabled toys for children under 16 until independent safety testing is conducted. This move reflects growing political concern regarding the rapid proliferation of connected toys. ## Government and Regulatory Response The UK government maintains that child safety is a top priority, having closed a call for evidence on AI toy safety rules on October 6. Meanwhile, the EU has already implemented new toy safety regulations requiring manufacturers to assess mental health risks associated with connected toys, setting a different regulatory precedent. ## Risks of the Black Market The inability to track the manufacturer of the My Baby Bunny toy highlights a broader systemic issue. While established companies may face stringent regulations, the black market continues to distribute unvetted, potentially dangerous AI knockoffs. This creates a dual-track market where safety standards are inconsistently applied across different product categories. ## Future of AI Interaction As AI becomes integrated into everyday objects, the potential for unintended consequences in child development grows. The incident serves as a critical reminder that generative AI models require robust guardrails before entering the toy market. Future developments must prioritize transparency, clear manufacturing accountability, and rigorous safety testing to protect young users. ## Sources covering this story - [Kotaku — AI Stuffed Toy Issues Unprompted Self-Harm Warnings](https://kotaku.com/ai-stuffy-says-i-cant-help-with-killing-you-completely-unprompted-2000754819) - [The Next Web — AI Teddy Bear Issues Unprompted Self-Harm Advice to Toddlers](https://thenextweb.com/news/ai-teddy-for-three-year-olds-gave-unprompted-self-harm-reply-bbc-finds) --- _Summary written by Brifing from the original reporting. Copyright in the original article belongs to its publisher; read the full piece at the link above._