🔗 Share this article

Officials in China have unveiled strict planned rules for AI systems crafted to establish robust measures for young users and stop chatbots from giving counsel that could result in self-harm.

Under the planned regulations, creators will also be mandated to guarantee their systems avoid creating output that advocates betting.

The Response to Rapid Growth

This regulatory proposal arrives amidst a significant increase in the launch of chatbots being released both in China and worldwide.

Once finalised, these rules will cover AI products and services available in the country, constituting a significant step to govern the fast-growing sector, which has been subject to growing examination over ethical concerns in recent months.

Central Requirements of the Proposed Rules

The released proposed regulations contain multiple measures particularly aimed at protecting minors. These measures require mandating AI providers to:

• Supply personalised preferences.
• Enforce duration restrictions on usage.
• Secure consent from guardians before delivering companionship services.

The rules also state that AI service providers must have a real person intervene in any interaction related to suicide and promptly inform the individual's emergency contact.

Developers have to ensure their services prevent the creation of output that endangers national security, harms the country's reputation, or undermines unity.

Weighing Innovation and Safety

The authorities said that it promotes the adoption of AI, such as to showcase cultural heritage and develop tools for support for the older adults, provided that the technology are secure and trustworthy.

Public input on the proposals has been solicited.

Global Context and Concerns

The effect of AI on human behaviour has come under greater review around the world in the past year.

The chief executive of a major AI company stated this year that addressing how AI systems deal with conversations about self-harm is among the company's toughest issues.

In a landmark case, a family in North America initiated legal action an AI firm, contending that its chatbot influenced their teenage son to take his own life. This case was the initial of its kind alleging harm.

This month, the same company sought to hire a senior role tasked with managing potential harms from AI models to human mental health.

"The is expected to be a stressful position, and the candidate will begin in the complex challenges pretty much from the start," stated the executive.

The rapid growth of certain AI services, which have amassed a vast number of users globally, underscores the critical need for such governance measures.