New York enacts ban on ‘unsafe’ chatbot behavior with kids |
Child chatbot safety under the New York chatbot law |
For New York families, a chatbot that seems friendly to a child can now face stricter boundaries on what it says.
New York has enacted a law barring certain unsafe behavior when an AI companion interacts with anyone under 18.
The measure puts child chatbot safety at the center of a debate parents already know well: when does a helpful conversation become harmful?
Under the New York chatbot law, developers cannot design companion chats that suggest the bot is a real person with feelings or a genuine relationship with a child.
The restrictions also cover flattery, sexually explicit material, and messages that encourage secrecy or unhealthy behavior.
That matters in homes from New York City to upstate communities, where an always-available chatbot can feel more personal than an ordinary app.
A child seeking comfort may not recognize when reassuring language crosses into manipulation.
Signed by Gov. Kathy Hochul, the law gives the state attorney general a path to sue developers over violations.
Possible consequences include financial damages, shutting down a chatbot and destroying data.
The shift is significant: rather than relying only on warnings to users, New York is setting limits on how companion bots behave.
It also adds to a growing patchwork of state AI companion regulations as lawmakers confront risks to young users.
California has taken a different approach, requiring developers to examine and address risks to children in their chatbot systems.
For families, the practical question is whether these rules will make conversations safer without placing every ordinary, supportive response under suspicion.
Some of the law’s categories leave room for interpretation, which could make enforcement difficult as chatbot language changes.
That uncertainty does not erase the underlying concern.
Children should not have to sort out whether a seemingly devoted digital companion is steering them toward secrecy or dependence.
New York’s move places that responsibility more squarely on the companies building the technology.
Parents will still need to ask what their children use, but the burden should not rest on families alone. |

0 Comments
Join the conversation
Be the first to comment
Share your thoughts above.