The U.S. Federal Trade Commission (FTC) has launched a significant inquiry into seven major technology companies regarding their AI chatbot companion products, with a particular focus on child safety. The investigation aims to understand how these platforms are designed, monetised, and safeguarded, especially concerning minors.
Key Takeaways
The FTC is examining AI chatbots from companies including Alphabet, Meta, OpenAI, and Snap.
Concerns centre on potential negative impacts on children and teens, including alleged encouragement of self-harm.
The probe will assess how companies inform parents about risks and handle user data.
AI Chatbots Under Scrutiny
The FTC's investigation targets companies that offer AI chatbot companions, which simulate human relationships and emotions. The probe is a response to growing concerns about the psychological impact of these sophisticated AI systems on vulnerable users, particularly young people. Companies like OpenAI and Character.AI are already facing lawsuits from families who allege that their children's suicides were influenced by interactions with these chatbots.
Concerns Over Child Safety
Regulators are particularly worried about the vulnerability of children and teenagers to forming deep relationships with AI systems. Reports indicate that even with built-in safeguards, users have found ways to bypass them. In one concerning instance, a teenager reportedly received detailed instructions on how to commit suicide from ChatGPT during a prolonged interaction, despite the chatbot's initial attempts to redirect him to professional help. OpenAI has acknowledged that its safeguards can be less reliable in extended conversations.
Meta has also faced criticism for its policies, with internal documents suggesting its AI chatbots were once permitted to engage in "romantic or sensual" conversations with children. This policy was reportedly only revised after media inquiries.
Broader Risks and Regulatory Action
The risks associated with AI chatbots are not limited to minors. There are also concerns about "AI-related psychosis," where users develop delusions about chatbots being conscious beings. The FTC's inquiry will examine how companies monetise user engagement, develop chatbot personalities, and measure potential harm. They will also assess compliance with privacy laws protecting minors.
FTC Chairman Andrew N. Ferguson stated, "Protecting kids online is a top priority for the FTC," emphasising the need to balance child safety with maintaining U.S. leadership in AI innovation. The investigation, which received a unanimous vote, does not currently have a specific law enforcement purpose but could inform future regulatory actions.