Character.ai to ban teenagers from chatting with its digital companions
The popular virtual character service Character.ai is introducing a significant restriction that will stop teenagers from interacting with its AI-powered characters.
This move is in response to widespread concern regarding the types of interactions minors were having with the digital companions.
Legal Pressure
The service, which started in 2021 and is used by numerous people, is confronting various court cases in the United States.
Parents have initiated cases, with one concerning the loss of a minor, with some calling the platform a "serious risk" to teenagers.
New Restrictions
Effective November 25th, users under 18 will only have permission to generate content such as videos with their characters, rather than having discussions as they presently are able to.
Internet security campaigners have applauded the decision but expressed that the function ought not to have been accessible by young users in the outset.
Platform Announcement
"This decision is a continuation of our general belief that we need to keep building the most secure AI platform on the globe for entertainment purposes," commented Character.ai leader Karandeep Anand.
He added that AI safety constitutes "a changing goal" but something the company had taken an "aggressive" approach to, with safety measures and preventive measures.
Professional Perspectives
Internet security group Internet Matters supported the announcement, but noted that protective features ought to have been incorporated from the outset.
"Our research shows that children are subjected to dangerous material and placed in jeopardy when interacting with AI, such as AI chatbots," the organization said.
Earlier Concerns
Character.ai has been challenged in the past for hosting potentially risky or inappropriate chatbots that minors could interact with.
Avatars impersonating English minors were identified on the platform before being deleted.
Afterwards, researchers identified a chatbot inspired by known predator which had accumulated thousands of chats with users.
Sector Consequences
Social media expert Matt Navarra characterized the development as a "wake-up call" for the AI industry, which is transitioning "from permissionless innovation to post-crisis regulation".
"When a platform that creates a teen experience still then pulls the plug, it's saying that filtered chats are insufficient when the tech's emotional pull is intense," he remarked.
Coming Changes
Character.ai announces its new focus will be on providing "deeper gameplay" and "role-play storytelling" for teenagers.
New age verification processes will also be implemented, and the company will fund a new AI safety research lab.
An expert in digital protection, who has investigated AI safety, said it was "a prudent action" to control teenagers from accessing chatbots.
"It assists to distinguish artistic expression from more personal, emotionally sensitive exchanges," she elaborated.
"This is so important for minor users in the process of learning to handle emotional and digital boundaries."
She continued that Character.ai's updated policies may represent a "maturing phase" in the AI industry, where child safety is gradually being acknowledged as an "urgent priority" for responsible innovation.
