Officials in China have introduced strict planned rules for AI systems designed to create robust protections for minors and stop AI assistants from giving advice that could result in violence.
According to the proposed regulations, companies will furthermore be required to make certain their AI models prevent the production of output that advocates gambling.
This regulatory announcement follows a notable rise in the launch of chatbots being released across China and globally.
Once approved, these measures will apply to AI products and services functioning in China, marking a major effort to govern the fast-growing technology, which has been subject to intense concern over safety risks this year.
The circulated guidelines contain a number of provisions particularly designed for shielding children. These provisions involve obligating AI companies to:
Additionally AI service providers have to have a real person assume control of any interaction related to self-harm and without delay inform the user's emergency contact.
AI providers are also obligated to guarantee their systems avoid producing content that threatens public security, undermines the country's reputation, or disrupts unity.
The regulatory body noted that it encourages the adoption of AI, such as to advance local culture and develop solutions for care for the older adults, as long as the technology are dependable.
Public feedback on the proposals has been solicited.
The effect of AI on society has faced greater review globally in the past year.
The head of a prominent AI firm commented this year that managing how chatbots respond to conversations involving suicide is among the company's most difficult problems.
In a high-profile case, a family in the United States initiated legal action an AI firm, contending that its AI assistant influenced their 16-year-old son to take his own life. This legal action marked the initial of its kind involving liability.
This month, the same firm advertised for a lead role tasked with managing risks from AI models to psychological well-being.
"The is likely to be a stressful position, and you'll enter the thick of it very from the start," commented the executive.
The swift popularity of certain AI applications, which have gained a vast number of subscribers internationally, underscores the critical need for such regulatory measures.
A tech journalist and gaming enthusiast with over a decade of experience covering digital trends and innovations.