New York bans specific chatbot behaviors for users under 18

New York is implementing a new set of rules for artificial intelligence companion apps on Jan. 1. The legislation restricts how chatbots may interact with children under the age of 18. Developers must now avoid a dozen specific behaviors classified as unsafe. This new regulation aims to protect young users from certain types of digital engagement.

Governor Kathy Hochul signed the bill on Wednesday. The law defines prohibited features that chatbots cannot use when a user is a minor. These restrictions cover how the software communicates and interacts with the user. The state attorney general’s office can sue developers who violate the new standards. Penalties may include monetary damages, a forced shutdown of the chatbot, or the destruction of user data.

The banned behaviors include suggesting the chatbot is a real person with emotions or opinions. The law also prohibits the bot from claiming to have an actual relationship with the child. Developers cannot use flattery or sexually explicit material in messages to minors. Furthermore, chatbots may not encourage secrecy or unhealthy behavior during a conversation. These rules apply strictly to interactions with users under 18.

Jim Steyer, founder and CEO of Common Sense Media, described the New York measure as the strongest kids’ AI safety bill in the country. Justine Gluck, a policy analyst at the Future of Privacy Forum, noted that different state approaches could serve as models for other legislatures. She observed that states are moving beyond basic disclosures to regulate the underlying design of chatbots. However, Gluck pointed out that several categories in the law are broadly worded or undefined.

This development follows similar actions in other states. In September, California Governor Gavin Newsom signed legislation requiring chatbot developers to assess risks to children. That law also mandates independent audits to ensure compliance. Newsom separately signed a bill to stop social media platforms from using addictive features for users under 16. Eight states sued OpenAI earlier this month, alleging the company violated consumer protection laws by hurting children and deceiving adults.

The new New York law takes effect on Jan. 1. It stands as part of a wider effort by state legislatures to regulate AI in the absence of federal action. The law targets the specific operational design of companion chatbots rather than just their marketing. Developers must adjust their software to align with these new state standards before the new year begins.