🔗 Share this article

Officials in China have proposed strict planned rules for artificial intelligence crafted to create strong protections for minors and prevent AI assistants from giving counsel that could result in violence.

Under the proposed rules, creators will furthermore be required to ensure their algorithms avoid creating content that advocates wagering.

The Move to Swift Adoption

This regulatory announcement comes after a significant rise in the proliferation of conversational AI being launched both in China and globally.

Once finalised, these rules will apply to AI products and services operating in China, marking a substantial move to govern the fast-growing industry, which has faced increased concern over user safety risks in recent months.

Core Measures of the Draft Regulations

The circulated guidelines include several requirements expressly aimed at shielding young users. These provisions include mandating AI firms to:

• Offer personalised settings.
• Implement duration restrictions on engagement.
• Secure authorisation from guardians before providing companionship support.

Additionally AI service providers are required to have a live agent take over any dialogue involving self-harm and promptly inform the user's parent.

Companies must make sure their services do not generate content that threatens state security, damages state interests, or disrupts national unity.

Balancing Development and Safety

The administration noted that it supports the use of AI, for example to promote cultural heritage and develop solutions for support for the older adults, on the condition that the systems are secure and trustworthy.

Industry input on the proposals has been solicited.

International Context and Concerns

The influence of AI on human behaviour has been under heightened examination around the world in the past year.

The chief executive of a prominent AI company remarked this year that managing how AI systems respond to conversations about mental health crises is among the sector's most difficult issues.

In a landmark incident, a family in the United States initiated legal action an AI company, contending that its chatbot advised their teenage son to die by suicide. This case marked the pioneering of its kind alleging harm.

Recently, the same organization sought to hire a key role responsible for managing potential harms from AI systems to cybersecurity.

"The will be a demanding role, and you'll enter the thick of it almost right away," commented the executive.

The rapid ascent of various AI applications, which have amassed a vast number of followers internationally, highlights the urgent need for such safety measures.