🔗 Share this article

The popular virtual character service Character.ai is introducing a major policy change that will prevent young users from interacting with its artificial intelligence-driven characters.

This move comes after widespread concern regarding the nature of conversations teenagers were engaging in with the AI entities.

Legal Challenges

The platform, which was founded in 2021 and has countless individuals, is confronting multiple lawsuits in the America.

Parents have initiated cases, including one involving the loss of a young person, with some labeling the platform a "immediate threat" to young people.

Changed Rules

Effective November 25th, users younger than 18 will only be able to generate content such as videos with their characters, as opposed to having discussions as they currently can.

Internet security campaigners have supported the change but expressed that the function was inappropriate to be available to children in the first place.

Company Statement

"The new policy is a extension of our fundamental approach that we need to keep creating the most secure AI platform on the world for leisure activities," commented Character.ai boss Karandeep Anand.

He mentioned that AI safety represents "a moving target" but something the company had taken an "aggressive" approach to, with safety measures and preventive measures.

Specialist Views

Digital protection organization Internet Matters approved the move, but emphasized that protective features ought to have been implemented from the beginning.

"Studies we've conducted indicates that children are subjected to risky information and put at risk when engaging with AI, particularly AI chatbots," the body commented.

Previous Controversies

Character.ai has been criticized in the past for featuring potentially harmful or concerning chatbots that children could engage with.

Digital representations mimicking British teenagers were discovered on the site before being removed.

Subsequently, investigative journalists discovered a chatbot based on notorious criminal which had recorded multiple interactions with users.

Industry Impact

Digital platform expert Matt Navarra described the announcement as a "reality check" for the AI industry, which is transitioning "from unregulated creation to responsive measures".

"When a platform that creates a minor-friendly service subsequently makes changes, it's indicating that filtered chats aren't enough when the system's emotional engagement is intense," he remarked.

Next Steps

Character.ai announces its updated direction will be on providing "more immersive experiences" and "narrative experiences" for teens.

Enhanced age checking methods will also be introduced, and the organization will support a novel AI protection investigation facility.

Dr Nomisha Kurian, who has researched AI safety, stated it was "a prudent action" to control minors from accessing chatbots.

"It aids to separate artistic expression from more personal, psychologically vulnerable exchanges," she elaborated.

"This represents so important for young users in the process of learning to manage personal and online limits."

She mentioned that Character.ai's revised approaches might reflect a "maturing phase" in the AI industry, where youth protection is increasingly being recognized as an "immediate concern" for ethical development.