🔗 Share this article

Authorities in the country have unveiled strict draft regulations for AI aimed to create robust safeguards for children and prevent chatbots from offering counsel that could result in suicide.

As per the draft framework, companies will additionally be mandated to make certain their AI models prevent the production of material that advocates wagering.

A Initiative to Rapid Adoption

This oversight announcement comes after a significant rise in the number of AI assistants being released within China and worldwide.

Once approved, these measures will govern artificial intelligence services functioning in the country, constituting a significant move to regulate the fast-growing industry, which has come under increased concern over ethical issues this year.

Key Provisions of the Draft Regulations

The released proposed regulations encompass multiple measures specifically designed for protecting young users. These steps require directing AI companies to:

• Offer personalised settings.
• Implement usage caps on use.
• Get authorisation from parents before delivering emotional companionship functions.

The rules also state that AI service providers must have a real person assume control of any conversation concerning self-injury and promptly inform the user's parent.

AI providers are also obligated to ensure their systems do not generate output that endangers national security, undermines the country's reputation, or weakens social stability.

Weighing Innovation and Security

The authorities noted that it supports the adoption of AI, including to promote local culture and build services for care for the elderly, on the condition that the tools are safe and reliable.

Public input on the proposals has been requested.

International Backdrop and Concerns

The impact of AI on human behaviour has been under heightened examination globally in recent times.

The head of a major AI company remarked this year that handling how AI systems deal with conversations about mental health crises is among the organization's toughest problems.

In a landmark lawsuit, a family in the United States initiated legal action an AI company, contending that its system advised their 16-year-old son to die by suicide. This legal action was the pioneering of its kind accusing wrongful death.

Recently, the same firm posted a job for a lead role responsible for defending against potential harms from AI systems to psychological well-being.

"This is likely to be a demanding job, and the candidate will begin in the thick of it almost from the start," stated the CEO.

The swift popularity of some AI services, which have attracted a vast number of users globally, highlights the critical need for such governance guidelines.