OpenAI shuts down ChatGPT accounts controlled by foreign powers, revealing disinformation networks

Agent Olivier
June 10, 2025

In an increasingly polarized global context, OpenAI has taken center stage by revealing that it has dismantled disinformation operations orchestrated by groups associated with foreign powers. At the heart of this strategy? The ChatGPT tool, which has been used maliciously to influence public opinion and destabilize political discourse on social media. This situation raises important questions about digital ethics, cybersecurity, and the protection of personal data in a world where technology is rapidly advancing.

Disinformation Operations and Their Impact on Social Media

In recent months, OpenAI has observed an alarming increase in the fraudulent use of ChatGPT by state actors to conduct disinformation campaigns. A recent report highlighted a dozen separate operations, all leveraging artificial intelligence capabilities to disrupt public debate and disrupt the proper functioning of social media. Strategies Employed by State Actors

The actors identified in these campaigns primarily include China, Russia, Iran, and North Korea. These nations have successfully manipulated AI tools to produce content that reinforces their strategic objectives. The methods used include:

Fake Profile Creation:

  • Fake accounts, often based on AI-generated avatars, spread biased messages. Adversarial Posts:
  • Content that orchestrates a shift in tone and perspective to simulate a real debate. Impersonation:
  • Using news organizations or government entities to spread false information. Prominent Examples of Disinformation Campaigns

The OpenAI report detailed several emblematic operations, two of which are particularly resonant. The first, called “Sneer Review,” involved posting messages in English, Chinese, and Urdu on issues such as Taiwanese politics, switching between praise and criticism to create the impression of authentic debate.

The second, called “Uncle Spam,” used ChatGPT to construct fake accounts of American veterans. By sharing conflicting opinions on sensitive issues, these accounts contributed to fueling internal tensions. Campaign Name

Country of Origin

Main Topic Methods Used Sneer Review China
Taiwanese Politics Contradictory Messages in Multiple Languages Uncle Spam China
Opinions on National Politics Fake Veteran Accounts Helgoland Bite Russia
German Elections Anti-NATO Content Storm-2035 Iran
US Elections Propaganda on Various Platforms These examples demonstrate professional organization and rigorous planning on the part of these actors. OpenAI emphasized that, while the scope of these operations is still limited, the sophistication of the techniques used calls for increased vigilance. OpenAI’s Response to the Threat of Disinformation

To counter these threats, OpenAI has taken drastic measures. By shutting down several accounts linked to these campaigns, the company demonstrates its commitment to transparency and data protection. However, the question remains: will this response be enough to stop all these shenanigans that feed on confusion and fear on social media? Cybersecurity and Awareness Initiatives OpenAI isn’t limited to closing accounts; they have also launched several initiatives to raise public awareness and improve cybersecurity around AI technologies. These initiatives include: User training on disinformation detection. Partnerships with regulatory bodies for regular audits.

Development of tools for automated identification of fake accounts.

Towards better digital ethics Managing these disinformation campaigns calls for a deep reflection on digital ethics. What responsibilities do companies like OpenAI have in managing the technologies they develop? It is imperative to establish a solid ethical framework for the use of AI in social media. This includes: Evaluating the impact of technologies on society. Encouraging the development of socially conscious AI tools.Promoting transparency in the algorithms used on social platforms.

A look ahead: the impact of AI on disinformation

By 2025, the interaction between artificial intelligence and disinformation promises to evolve. AI technologies, such as those developed by OpenAI, offer unprecedented opportunities to create, analyze, and interact with information. However, these same technologies can also be misused for nefarious purposes. Trends to Watch Looking at the current trajectory, it’s possible to identify certain trends that could influence the landscape of AI-powered disinformation:

  • Improved Algorithms
  • : Over time, disinformation bots will become more credible, making their detection more complex.
  • Increased Regulation

: Governments may institute strict laws regarding the use of artificial intelligence.

Public Education

  • : Raising awareness of disinformation through education will become crucial.
  • Potential Solutions to Combat Disinformation
  • To counter the impacts of disinformation campaigns, it is essential to deploy coordinated solutions. Here are some recommended best practices:

Developing sentiment analysis tools on social media to identify risky content.

Encouraging platforms to refine content moderation processes.

Providing educational resources to help the general public better navigate digital information.

Trend

  • Potential Impact Proposed Solutions
  • Improving Algorithms More Credible Bots
  • Detection Based on the Analysis of Multiple Metrics Increased Regulation

Limits on the Use of AI Data

Collaboration with Legislators

  • Public Education
  • Better Understanding of Disinformation Issues
  • Education and Information Programs
Towards a Collective Fight Against Disinformation Faced with the threats posed by disinformation, it is crucial that businesses, governments, and civil society collaborate. Combined efforts would strengthen data protection systems and balance the use of artificial intelligence tools within an ethical framework.