This Cloudflare feature stops AI bots from scraping your site and sends them down an endless rabbit hole to waste their time
Stop bots from scraping your website with this Cloudflare feature.
If you run a website today, there’s a good chance that AI bots are trying to index and scrape your content. Cloudflare sees more than 50 billion AI crawler requests each day on its network. Many of these bots ignore standard “no crawl” rules and, without the site owner’s consent, siphon off content to train large language models. Blocking them outright often just tips them off, prompting them to change tactics.
![It wasn't just you, Apple Intelligence was down [u]](https://photos5.appleinsider.com/gallery/64086-133417-IMG_2283-xl.jpg)
