Meta bans Israeli firm for AI-generated deceptive content

Meta bans Israeli firm for AI-generated deceptive content is profiled by BTW Media because published evidence links it to internet infrastructure, governance, operational dependencies, or market visibility.

• Meta Platforms dismantled a network of fake accounts, totaling over 500 on Facebook and 32 on Instagram, associated with an Israeli technology firm.
• Despite Meta’s automated systems detecting and disabling a significant portion of the network, concerns remain about the spread of inauthentic content on social media platform. Meta said it has banned the firm from its platform.
• As the presidential election approaches in the European Union and the United States, governments and tech firms are closely monitoring the use of artificial intelligence in elections and the attempts of foreign actors to influence U.S. political opinions and foster discord.

Meta disclosed that some fake accounts posing as Jewish students and other students have used fake content which may be generated by artificial intelligence on Facebook and Instagram to make comments against users in the United States and Canada. Meta attributed the series of deceptive information to a Tel Aviv-based political marketing firm STOIC.

STOIC representatives didn’t immediately respond to messages seeking comment about the Meta report.

Deceptive contents on Meta platforms

Meta Platforms dismantled a network of fake accounts, totaling over 500 on Facebook and 32 on Instagram, associated with an Israeli technology firm.

These accounts, posing as U.S. and Canadian locals, including Jewish students and African-Americans, used AI-generated comments to praise Israel and criticise campus antisemitism.

The comments, primarily in English, focused on topics such as the release of Israeli hostages, support for Israel’s military actions, and criticisms of radical Islam and campus antisemitism.

Despite Meta’s automated systems detecting and disabling a significant portion of the network, concerns remain about the spread of inauthentic content on social media platform. Meta said it has banned the firm from its platform.

Also read: Intuit raises annual estimates on demand for AI-driven products

Also read: AI helping find a partner for ‘world’s loneliest plant’

Concerns over generative AI technology

Meta and other tech giants have been struggling to address the potential misuse of new AI technology, especially in elections.

As the presidential election approaches in the European Union and the United States, governments and tech firms are closely monitoring the use of artificial intelligence in elections and the attempts of foreign actors to influence U.S. political opinions and foster discord. Users are leveraging generative AI, encompassing AI tools capable of producing convincingly fluent text, realistic images, and videos, to share content on Meta’s platforms. Despite Meta’s assertion that it did not impede their ability to disrupt such networks, concerns remain about the misuse of AI technologies in influence operations, especially with upcoming elections, posing key tests for Meta’s defenses against such deceptive content.