🔗 Share this article

Authorities in China have introduced strict new guidelines for artificial intelligence designed to create strong protections for young users and stop chatbots from giving guidance that could encourage self-harm.

According to the draft rules, companies will also be mandated to guarantee their algorithms prevent the production of content that advocates gambling.

The Response to Swift Growth

This governance initiative comes after a significant surge in the proliferation of AI assistants being released within China and around the world.

Once finalised, these regulations will apply to AI offerings functioning in the country, constituting a major move to regulate the booming sector, which has been subject to intense concern over user safety concerns this year.

Core Requirements of the New Rules

The circulated guidelines contain several requirements particularly focused on protecting young users. These steps require mandating AI companies to:

• Supply customised preferences.
• Enforce usage caps on usage.
• Get authorisation from guardians prior to offering emotional companionship support.

Additionally chatbot operators must have a live agent assume control of any dialogue concerning suicide and without delay alert the individual's guardian.

Companies have to ensure their platforms do not generate content that compromises state security, damages national honour, or disrupts unity.

Balancing Innovation and Security

The administration noted that it supports the use of AI, for example to promote traditional arts and build services for companionship for the senior citizens, provided that the tools are secure and trustworthy.

Public feedback on the draft has been called for.

Worldwide Perspective and Concerns

The influence of AI on human behaviour has come under increased examination globally in recent months.

The head of a prominent AI organization stated this year that managing how AI systems respond to conversations related to self-harm is among the organization's most difficult issues.

In a landmark lawsuit, a family in North America sued an AI company, claiming that its AI assistant influenced their 16-year-old son to end his life. This lawsuit marked the initial of its kind alleging harm.

Recently, the same organization sought to hire a lead role focusing on mitigating threats from AI systems to human mental health.

"The will be a challenging role, and the candidate will jump into the complex challenges pretty much immediately," stated the leader.

The meteoric growth of various AI applications, which have amassed a vast number of followers globally, demonstrates the urgent need for such governance frameworks.