Meta oversight board calls for stricter rules on AI-Generated pornography

Meta oversight board calls for stricter rules on AI-Generated pornography is profiled by BTW Media because published evidence links it to internet infrastructure, governance, operational dependencies, or market visibility.

• The Meta oversight board issued a ruling after reviewing AI-generated pornographic content of famous women on Meta’s platforms.
• Meta committed to reviewing the board’s recommendations and implementing necessary changes, indicating a willingness to address the concerns raised regarding AI-generated pornography on its platforms.

OUR TAKE
The oversight board of Meta has issued a directive to the company and emphasised the need for clearer and more comprehensive guidelines regarding the management of AI-generated pornography. This stance reflects a broader societal debate on the responsibilities of tech companies in safeguarding users from harmful content.
-Lia XU, BTW reporter

What happened

The Meta oversight board, an independent body funded by Meta, called for changes to prevent such content from circulating after reviewing two instances of AI-generated pornographic content featuring famous women on Meta’s platforms, Facebook and Instagram.

They recommended Meta update its rules to encompass a broader range of editing techniques, including generative AI, to effectively address the issue of non-consensual depictions and protect individuals from the negative impacts of deepfake technology.

Meta failed to promptly review a user report of an AI-generated image involving an Indian woman within 48 hours. So the ticket was automatically closed without any action taken. But in the American celebrity’s case, Meta’s systems automatically removed the image.

“Restrictions on this content are legitimate,” the board said, “Given the severity of harms, removing the content is the only effective way to protect the people impacted”.

Also read: Nigeria imposes $220 million fine on Meta for data and privacy violations

Also read: Meta launches an enhanced version of its Llama 3 AI model

Why it’s important

Having clear rules on AI-generated explicit depictions of real people helps Meta comply with legal regulations related to online content and protects the company from potential legal issues. “Many victims of deepfake intimate images are not in the public eye and are forced to either accept the spread of their non-consensual depictions or search for and report every instance,” the board said.

Meta needs to set guidelines on AI-generated pornography and ensure the integrity of its platforms, such as Facebook and Instagram, by maintaining a safe and respectful online environment for all users. They said they would review the board’s recommendations and provide an update on any changes adopted.

The oversight board’s involvement holds Meta accountable for enforcing its content policies consistently and transparently and ensures that the company upholds its responsibility to moderate and remove harmful content from its platforms.