As China reels from the recent impact of Typhoon Noul, authorities are increasingly concerned about the proliferation of misleading content generated by Artificial Intelligence (AI). These deceptive videos have inundated social media, showing fabricated images and false details about flooding and emergency responses.
Impacts of Misinformation
Recent months have witnessed a surge in fake videos depicting non-existent flooding and misleading images, such as bodies in floodwaters, which have not occurred. In some cases, these videos have triggered unnecessary panic, causing residents to stockpile emergency supplies due to false reports of power outages.
One notable incident involved flooding in Hengzhou city, Guangxi, which resulted in the escape of hundreds of snakes from a breeding farm. This was followed by fake images claiming crocodiles were released into a river. Such misinformation exacerbates already delicate situations involving mass evacuations and rescue operations.
The Role of AI in Misinformation
China's investment in AI technology, intended to bolster its technological prowess, has inadvertently facilitated the creation of misleading content. Huang Zhihua, Deputy Chief for Zhejiang Police Department, highlighted how creators exploit disaster news to gain followers by fabricating sensational content.
In response, authorities have taken measures to penalize those creating false content, with consequences ranging from fines to detention. Experts caution that an unprecedented crisis of misinformation may be looming, as AI drastically reduces the technical barriers to producing fake content.
"AI dramatically lowers the technical barriers to producing false information," stated Professor Chen Bin in a Communist Party publication. "Individuals no longer require sophisticated technical skills to generate convincing fake content."
Efforts to Combat False Content
There have been discussions about marking all AI-generated content, but such labels can be easily removed. Professor Xu Xiaoke from Beijing Normal University emphasized the need for improved verification methods, though detection technology still lags behind generation capabilities.
The Chinese government, committed to becoming a tech superpower, is investing heavily in AI, with over 6,000 AI companies reported. Professor Xu suggests building trusted information infrastructures, including government early warning systems, to counter misinformation.
Trust Issues and Official Responses
Public trust in official sources has been eroded by instances where authorities have downplayed disasters. For example, officials instructed journalists to describe a dam breach as a "gap" instead of a serious breach, contributing to public distrust.
Gao Kai from the Ningbo Public Security Bureau urges the public to trust accredited sources during emergencies, warning against reliance on unverified information. A specialized task force has been established to monitor social media and swiftly address false content.
China's Cyberspace Administration has initiated a nationwide crackdown on fake internet content related to disasters, directing local branches to focus on identifying fabricated data and other misleading content.
Legal and Educational Measures
Professor Gao advocates for a combination of public education and law enforcement to tackle AI-generated misinformation. While existing laws are deemed sufficient, others, like Professor Chen, argue that legal frameworks struggle to keep pace with rapidly evolving AI technology.
International lawyer Peter Pang suggests holding platforms and AI app creators accountable for enabling the spread of misinformation. He emphasizes that responsibility should extend to those who create content that induces panic and its subsequent consequences.
Professor Xu foresees an increase in AI-generated misinformation, particularly in high-risk areas such as elections, public health emergencies, and natural disasters. He stresses the need for proactive measures to prevent false information from spreading uncontrollably.
