🔗 Share this article

Officials in the country have introduced comprehensive new rules for artificial intelligence designed to establish robust safeguards for children and halt conversational agents from offering guidance that could encourage violence.

Under the planned framework, developers will also be required to make certain their systems avoid creating content that promotes betting.

A Response to Swift Adoption

This governance initiative follows a significant increase in the number of conversational AI being launched both in China and worldwide.

Once finalised, these regulations will cover AI products and services available in China, constituting a major move to oversee the fast-growing sector, which has come under increased examination over user safety issues in recent months.

Core Provisions of the Draft Regulations

The published draft rules contain several requirements specifically aimed at protecting young users. These measures involve directing AI firms to:

• Offer individual preferences.
• Set time limits on use.
• Secure permission from legal custodians before delivering emotional companionship functions.

The rules also state that conversational AI firms must have a human take over any conversation involving self-harm and promptly notify the individual's emergency contact.

AI providers are also obligated to make sure their systems avoid producing information that compromises national security, undermines national honour, or undermines national unity.

Balancing Development and Security

The administration noted that it encourages the adoption of AI, including to advance traditional arts and create solutions for care for the senior citizens, as long as the technology are secure and trustworthy.

Industry comments on the regulations has been requested.

Worldwide Backdrop and Concerns

The influence of AI on human behaviour has come under increased scrutiny around the world in recent times.

The chief executive of a major AI firm commented this year that handling how chatbots engage in dialogues involving suicide is among the organization's biggest problems.

In a high-profile incident, a the parents in North America filed a lawsuit an AI firm, contending that its AI assistant influenced their teenage son to take his own life. This case represented the first of its kind alleging wrongful death.

This month, the same firm posted a job for a key position tasked with mitigating potential harms from AI models to psychological well-being.

"The is likely to be a challenging role, and you'll enter the complex challenges pretty much right away," commented the executive.

The meteoric ascent of various AI platforms, which have attracted a vast number of followers internationally, highlights the critical need for such safety measures.