Cloudflare blocks AI shopping agents from ad-supported pages

The infrastructure company is splitting the web between human readers and AI crawlers, putting shopping agents at odds with publishers.

By ·

Sep 17, 2026

7 cards · 1m 40s · tap to begin

From · · · 1m 40s

Cloudflare blocks AI shopping agents from ad-supported pages

The infrastructure company is splitting the web between human readers and AI crawlers, putting shopping agents at odds with publishers.

In brief

The infrastructure company is splitting the web between human readers and AI crawlers, putting shopping agents at odds with publishers. Cloudflare's new default blocks AI shopping agents on ad-supported pages, but retailers who convert better through AI referrals may opt out. Originally reported by Pymnts.

Cloudflare blocks AI agents on ads

Cloudflare now treats ads as proof a page was built for humans. Search bots still work, but AI shopping agents are blocked by default on any ad-supported page.

“an ad is proof a page was built for a person to see”

AI crawler traffic exploded

AI training now makes up 52% of crawler traffic on Cloudflare's network, up from 22% a year ago. That surge prompted the company to split its blocking controls.

Site owners are already blocking AI

Site owners are already blocking AI

17% of Cloudflare's sites restrict AI training, while fewer than 1% block search bots. That gap shows site owners see AI crawlers as a bigger threat than search engines.

Retailers see better conversion

AI referrals convert at 3 to 5 times the rate of traditional search. Retailers like Walmart and Target are testing partnerships with AI platforms instead of blocking them.

132 million Americans use AI to shop

Nearly 132 million U.S. adults have bought products with AI's help, yet only 23% of merchants can see that traffic and connect it to sales.

Amazon still wins the checkout

59% of AI-assisted purchases end at Amazon. Consumers use AI agents to compare options, then buy where they already shop, leaving agents with limited leverage.

Publishers face the biggest hit

Review sites and comparison guides that shopping agents read before checkout are blocked hardest by Cloudflare's new default. These sites lose traffic without gaining direct sales.

The key point

Cloudflare's new default blocks AI shopping agents on ad-supported pages, but retailers who convert better through AI referrals may opt out.

Read the original on Pymnts

React

Sign in to react and comment.

Comments (0)

Life is short. Keep it sweet. Respect others' opinions and be kind!

    Recommended next

    More decks on cloudflare and related topics.