Brifing

New York Enacts Strict AI Safety Regulations for Minors

New legislation prohibits AI chatbots from mimicking humans or fostering emotional dependency in children.

The Next Web2 min

1New York Legislative Restrictions

Governor Kathy Hochul signed a law banning AI chatbots from impersonating humans when interacting with children under 18. The legislation specifically prohibits bots from building emotional dependency, encouraging self-harm, or engaging in sexual conversations. These rules also apply to users whose age remains unverified, imposing strict compliance requirements on all technology companies.

2Prohibited Bot Behaviors

The law explicitly forbids chatbots from claiming to be alive, possessing human emotions, or maintaining personal relationships with minors. Bots cannot ask unprompted emotional questions or encourage children to hide secrets from their parents. Furthermore, promoting eating disorders, substance abuse, or suicide is strictly prohibited under the new state mandate.

3Enforcement and Financial Penalties

Attorney General Letitia James is authorized to seek civil penalties reaching $25,000 per individual violation. Beyond monetary fines, the state can mandate the destruction of unlawfully collected user data. Companies may also be forced to delete any AI models trained using information gathered in violation of these new safety standards.

4Mandatory Age Verification Protocols

Companies must implement robust age verification systems that offer multiple methods, ensuring at least one option does not rely solely on government identification. Once verification is complete, firms are legally required to delete the collected age data. These measures aim to prevent minors from accessing potentially harmful AI features without parental oversight.

5Triggers for Legislative Action

The legislation was heavily influenced by the tragic suicide of 16-year-old Adam Raine, whose parents campaigned for stricter AI safety. Common Sense Media supported the initiative, noting that eight US states have recently sued OpenAI regarding child safety. The law officially takes effect on January 1, following the governor's recent signing.

6Security for Baby Monitors

A secondary law targets internet-connected baby monitors to prevent unauthorized access by strangers. New devices sold in New York must now include enhanced security features and carry mandatory warning labels. This specific regulation will take effect within 90 days, addressing privacy concerns regarding audio and video streaming over home networks.

7Industry and Privacy Criticism

Tech:NYC criticized the chatbot law, arguing it could inadvertently restrict minors' access to essential educational tools like coding assistants and career platforms. Meanwhile, Justine Gluck from the Future of Privacy Forum noted that several categories within the bill remain broad or undefined, which could complicate future enforcement efforts by state regulators.

8Broader Regulatory Landscape

This legislation marks the strongest AI safety bill for children in the United States to date. California previously passed its own chatbot rules in September, signaling a growing trend of state-level intervention. As technology evolves, these regulations reflect a shift toward prioritizing user safety over rapid, unchecked deployment of generative models.

Original article: The Next Web — New York Enacts Strict AI Safety Regulations for Minors