AI-Generated Misinformation

The increasing prevalence of artificial intelligence (AI)-generated content is contributing to the growing distress people experience when online. A 2024 Reuters report found that 72 percent of Americans are worried about distinguishing between real and fake information in online news.

Content moderation has always been a challenge for social media due to the vast user base and varying regulations across countries, and AI-generated content has become an unavoidable aspect of online feeds. This issue becomes even more problematic when politicians exploit such misleading content to manipulate public sentiment.

Platforms such as Facebook have been flooded with AI-generated spam and scams, creating risks such as identity theft, fraud, and other illegal activities. Despite Meta's ongoing efforts to moderate content and label AI-generated material, many scams and emotionally manipulative clickbait remain widespread, and its January 2025 decision to replace third-party fact-checkers with user-generated "community notes" on its platforms could further encourage the spread of disinformation.

Planners should stay informed about social media literacy issues and be aware of the potential for AI-generated misinformation to affect community conversations.