Artificial intelligence (AI) is currently used not only to answer questions; many people communicate with chatbots, viewing them as friends, partners, or even family members. However, China has taken significant measures regarding this use of AI.
On July 15, China introduced new regulations for AI chatbots that mimic human conversation and provide emotional support. The goal of these regulations is to reduce the level of emotional dependence arising from AI and prevent other related problems.
Under the new requirements, AI must clearly inform the user that it is not human. Furthermore, chatbots must inform the user of their online status every two hours.
Preventing Emotional Dependence on AI
The new norms prohibit AI chatbots from fostering excessive user dependence on them. They are forbidden from using phrases that could evoke strong emotional attachment. Additionally, AI must avoid statements claiming to be the user's closest or sole companion. Moreover, chatbots are not allowed to incite or hint at suicide or self-harm.
Stricter Rules for Children
Additional restrictions have been introduced for minors in China. Children under 14 years old require parental consent to use AI that mimics human conversation. As for teenagers aged 14 to 18, they are prohibited from using virtual partners such as AI boyfriends, girlfriends, husbands, or wives.
Fines for Companies Violating the Rules
Companies that fail to comply with these rules may face a fine of up to two million yuan. Some major technology companies have already removed companion features from their AI assistants even before the rules came into effect.
Research has also revealed concerns regarding AI-based companion apps. According to one study, users with few friends or close relatives are more likely to use AI chatbots. Excessive use of such bots is linked to feelings of loneliness.
China's steps have sparked a wide discussion about how necessary government restrictions are to protect people from emotional harm caused by AI, and what the acceptable level of state intervention in citizens' private lives should be.