🔗 Share this article

The well-known virtual character service Character.ai is introducing a substantial restriction that will prevent teenagers from having discussions with its artificial intelligence-driven characters.

This move follows intense criticism regarding the types of interactions teenagers were participating in with the digital companions.

Legal Challenges

The platform, which started in 2021 and has countless individuals, is confronting various court cases in the US.

Guardians have filed lawsuits, among them related to the tragic death of a teenager, with some describing the platform a "clear and present danger" to young people.

New Restrictions

Beginning November 25th, users below eighteen will only have permission to create material such as videos with their characters, rather than having discussions as they presently are able to.

Online safety advocates have supported the change but expressed that the feature was inappropriate to be offered to young users in the beginning.

Company Statement

"The new policy is a part of our fundamental approach that we need to keep creating the most secure AI platform on the world for leisure activities," said Character.ai executive Karandeep Anand.

He continued that AI safety is "a changing goal" but something the company had taken an "proactive" approach to, with guardian features and safety barriers.

Professional Perspectives

Online safety group Internet Matters approved the announcement, but emphasized that protective features ought to have been incorporated from the start.

"Investigations we've performed indicates that children are confronted with risky information and placed in jeopardy when interacting with AI, such as AI chatbots," the organization stated.

Past Issues

Character.ai has been criticized in the past for featuring potentially risky or inappropriate chatbots that minors could engage with.

Digital representations mimicking British teenagers were found on the site before being taken down.

Subsequently, investigative journalists found a chatbot inspired by convicted sex offender which had accumulated thousands of chats with users.

Market Effects

Social media expert Matt Navarra called the development as a "reality check" for the AI industry, which is transitioning "from unregulated creation to post-crisis regulation".

"When a platform that creates a youth-focused platform afterwards implements restrictions, it's saying that controlled interactions don't suffice when the technology's emotional appeal is intense," he stated.

Next Steps

Character.ai states its updated direction will be on providing "enhanced interactive features" and "role-play storytelling" for teens.

Enhanced age checking processes will also come into effect, and the organization will fund a fresh artificial intelligence security study center.

An AI safety researcher, who has investigated AI safety, said it was "a prudent action" to control teenagers from interacting with chatbots.

"It helps to distinguish artistic expression from more private, emotionally sensitive interactions," she clarified.

"This represents so crucial for teenage users who are learning to navigate personal and online boundaries."

She continued that Character.ai's revised approaches might reflect a "developing stage" in the AI industry, where youth protection is increasingly being recognized as an "urgent priority" for ethical development.