From Pymnts · PYMNTS · · 1m 40s
Cloudflare blocks AI shopping agents from ad-supported pages
The infrastructure company is splitting the web between human readers and AI crawlers, putting shopping agents at odds with publishers.
In brief
The infrastructure company is splitting the web between human readers and AI crawlers, putting shopping agents at odds with publishers. Cloudflare's new default blocks AI shopping agents on ad-supported pages, but retailers who convert better through AI referrals may opt out. Originally reported by Pymnts.
Cloudflare blocks AI agents on ads
Cloudflare now treats ads as proof a page was built for humans. Search bots still work, but AI shopping agents are blocked by default on any ad-supported page.
“an ad is proof a page was built for a person to see”
AI crawler traffic exploded
AI training now makes up 52% of crawler traffic on Cloudflare's network, up from 22% a year ago. That surge prompted the company to split its blocking controls.
Site owners are already blocking AI

17% of Cloudflare's sites restrict AI training, while fewer than 1% block search bots. That gap shows site owners see AI crawlers as a bigger threat than search engines.
Retailers see better conversion
AI referrals convert at 3 to 5 times the rate of traditional search. Retailers like Walmart and Target are testing partnerships with AI platforms instead of blocking them.
132 million Americans use AI to shop
Nearly 132 million U.S. adults have bought products with AI's help, yet only 23% of merchants can see that traffic and connect it to sales.
Amazon still wins the checkout
59% of AI-assisted purchases end at Amazon. Consumers use AI agents to compare options, then buy where they already shop, leaving agents with limited leverage.
Publishers face the biggest hit
Review sites and comparison guides that shopping agents read before checkout are blocked hardest by Cloudflare's new default. These sites lose traffic without gaining direct sales.
The key point
Cloudflare's new default blocks AI shopping agents on ad-supported pages, but retailers who convert better through AI referrals may opt out.




