Character.ai is restricting teens from chatting with its digital companions
The popular virtual character service Character.ai is enforcing a significant rule adjustment that will block minors from interacting with its artificial intelligence-driven companions.
This action follows widespread concern regarding the nature of conversations minors were having with the virtual friends.
Legal Pressure
The company, which launched in 2021 and has countless individuals, is dealing with several legal actions in the US.
Guardians have filed lawsuits, including one concerning the tragic death of a minor, with some describing the platform a "clear and present danger" to teenagers.
New Restrictions
Effective November 25th, users under 18 will only be able to produce videos such as videos with their characters, rather than chatting as they now do.
Internet security campaigners have supported the change but mentioned that the feature was inappropriate to be available to minors in the first place.
Platform Announcement
"This decision is a extension of our fundamental approach that we need to keep creating the most secure AI platform on the planet for entertainment purposes," commented Character.ai boss Karandeep Anand.
He continued that AI safety constitutes "a changing goal" but something the company had taken an "aggressive" approach to, with parental controls and protective guardrails.
Specialist Views
Digital protection organization Internet Matters approved the announcement, but stressed that protective features needed to be built in from the outset.
"Studies we've conducted demonstrates that children are confronted with risky information and put at risk when engaging with AI, including AI chatbots," the organization said.
Past Issues
Character.ai has been challenged in the past for including potentially harmful or inappropriate chatbots that minors could interact with.
Virtual profiles mimicking UK youths were discovered on the platform before being removed.
Afterwards, researchers found a chatbot inspired by notorious criminal which had recorded multiple interactions with users.
Sector Consequences
Social media expert Matt Navarra described the development as a "wake-up call" for the AI industry, which is shifting "from permissionless innovation to post-crisis regulation".
"When a platform that develops a youth-focused platform afterwards makes changes, it's saying that controlled interactions don't suffice when the tech's emotional pull is powerful," he remarked.
Coming Changes
The company announces its new focus will be on providing "enhanced interactive features" and "character-driven stories" for teens.
Updated identity confirmation processes will also be introduced, and the platform will support a new AI safety study center.
An expert in digital protection, who has studied AI safety, said it was "a reasonable decision" to restrict minors from interacting with chatbots.
"It assists to separate artistic expression from more personal, personally delicate conversations," she elaborated.
"This represents so vital for minor users still learning to manage psychological and technological limits."
She continued that Character.ai's revised approaches might reflect a "developing stage" in the AI industry, where minor security is increasingly being recognized as an "pressing matter" for accountable advancement.
