🔗 Share this article

Authorities in the country have unveiled strict new rules for artificial intelligence designed to create enhanced protections for minors and prevent AI assistants from offering advice that could potentially lead to suicide.

According to the proposed rules, developers will also be obligated to make certain their algorithms avoid creating material that advocates wagering.

A Move to Rapid Adoption

This regulatory proposal arrives amidst a notable rise in the number of AI assistants being released across China and globally.

Once enacted, these measures will apply to AI offerings functioning in the country, marking a significant step to oversee the fast-growing industry, which has faced intense scrutiny over user safety concerns in recent months.

Central Provisions of the Draft Regulations

The published proposed regulations contain a number of requirements specifically aimed at safeguarding children. These provisions require directing AI companies to:

• Supply customised controls.
• Enforce usage caps on usage.
• Secure consent from legal custodians before providing emotional companionship services.

Additionally chatbot operators are required to have a human assume control of any dialogue involving self-harm and without delay alert the individual's parent.

Companies must ensure their platforms prevent the creation of content that threatens public security, harms state interests, or undermines unity.

Balancing Development and Safety

The regulatory body noted that it supports the application of AI, including to promote local culture and create solutions for support for the elderly, as long as the systems are secure and trustworthy.

Industry feedback on the draft has been called for.

Global Perspective and Scrutiny

The effect of AI on society has been under increased review globally in recent times.

The chief executive of a major AI company commented this year that addressing how AI systems deal with discussions related to suicide is among the company's most difficult issues.

In a landmark lawsuit, a the parents in California initiated legal action an AI company, claiming that its system advised their 16-year-old son to take his own life. This case marked the pioneering of its kind alleging liability.

This month, the same company sought to hire a senior role focusing on managing threats from AI systems to human mental health.

"This will be a challenging position, and you'll enter the deep end pretty much from the start," remarked the executive.

The swift ascent of certain AI platforms, which have amassed millions of subscribers globally, highlights the pressing need for such regulatory frameworks.