Trends

Meta bans Israeli firm for AI-generated deceptive content

Meta Platforms dismantled a network of fake accounts, totaling over 500 on Facebook and 32 on Instagram, praise sensitive contents.

Meta_i_Almedalen

Headline

Meta Platforms dismantled a network of fake accounts, totaling over 500 on Facebook and 32 on Instagram, praise sensitive contents.

Context

Meta disclosed that some fake accounts posing as Jewish students and other students have used fake content which may be generated by artificial intelligence on Facebook and Instagram to make comments against users in the United States and Canada. Meta attributed the series of deceptive information to a Tel Aviv-based political marketing firm STOIC. STOIC representatives didn’t immediately respond to messages seeking comment about the Meta report.

Evidence

Pending intelligence enrichment.

Analysis

Meta Platforms dismantled a network of fake accounts, totaling over 500 on Facebook and 32 on Instagram, associated with an Israeli technology firm. These accounts, posing as U.S. and Canadian locals, including Jewish students and African-Americans, used AI-generated comments to praise Israel and criticise campus antisemitism. The comments, primarily in English, focused on topics such as the release of Israeli hostages, support for Israel’s military actions, and criticisms of radical Islam and campus antisemitism. Despite Meta’s automated systems detecting and disabling a significant portion of the network, concerns remain about the spread of inauthentic content on social media platform. Meta said it has banned the firm from its platform.

Key Points

  • Meta Platforms dismantled a network of fake accounts, totaling over 500 on Facebook and 32 on Instagram, associated with an Israeli technology firm.
  • Despite Meta’s automated systems detecting and disabling a significant portion of the network, concerns remain about the spread of inauthentic content on social media platform. Meta said it has banned the firm from its platform.
  • As the presidential election approaches in the European Union and the United States, governments and tech firms are closely monitoring the use of artificial intelligence in elections and the attempts of foreign actors to influence U.S. political opinions and foster discord.

Actions

Pending intelligence enrichment.

Author

Miurio Huang