Cloudflare launches tool to combat AI robots

  • Cloudflare launches a free tool to prevent artificial intelligence from scraping data from websites hosted on its platform.
  • Cloudflare’s tools effectively detect clandestine AI bots.

Due to the booming development of artificial intelligence and the increasing demand for model training data, the problem of AI bots scraping data has become more prominent, and many websites are working to prevent AI scraping and crawling.
–Zora Lin, BTW reporter

What happened

Cloud service provider Cloudflare has launched a free tool to prevent bots from scraping websites on its platform for AI model training data.

The tool was developed after analysing AI bot and crawler traffic to fine-tune an automated robot detection model that can identify bots trying to evade detection by mimicking human web browser behavior.

Cloudflare has also set up a form for hosts to report suspicious AI bots and crawlers, and will continue to manually blacklist AI bots.

Also read: When was the first AI robot made?

Also read: Brazil orders Meta to stop training its AI on personal data

Why it’s important

Cloudflare’s tools help website owners identify and block malicious programs, prevent bots and crawlers from scraping content, and protect website data.

The training of AI models often relies on large amounts of data. If a malicious party gains access to this data, it could result in misuse of the data or the security of the model being compromised. Cloudflare’s tools help ensure that data is only used by entities authorised to access it, thereby protecting the security and integrity of AI model training data.

Cloudflare encourages hosts to report suspicious AI bots and bots, and this cooperation and transparency promotes collaboration among the global cybersecurity community to combat cyber threats.


Zora Lin

Zora Lin is an intern news reporter at Blue Tech Wave specialising in Products and AI. She graduated from Chang’an University. Send tips to

Related Posts

Leave a Reply

Your email address will not be published. Required fields are marked *