Recrawled Radar

What changed, whether it matters, what we're doing about it.

AI search moves monthly. We watch it for our clients anyway, so here are the changes worth a business owner's attention: what changed, why it matters, what we're doing.

The board.

4entries since 6 March 2026
2high-impact changes we've acted on
2entries in Q3 2026
Last updated10 September 2026Watching Google AI Overviews and AI Mode, Gemini, ChatGPT and Claude
Google high impact

Google is folding AI Overviews into AI Mode, and ran a spam update on the way.

What changed

Through late August Google began moving people who expand an AI Overview straight into the AI Mode interface, removing the old "show more" step, and added link carousels for developing stories. Separately, the August 2026 spam update rolled out from 18 to 21 August, with a further ranking change on 4 September that Google has since reverted.

Why it matters, and what we're doing

Why it matters

More of the answer now happens in AI Mode, which runs several searches behind one question and cites a broader set of sources than a classic result page. Being the page an AI Mode fan-out lands on matters more than a blue-link position, and scaled thin content is being caught faster.

What we're doing

AI Mode is already a first-class surface in every client's monthly read. This month we're checking which pages AI Mode cites for each tracked prompt against the ones we planned for, and re-prioritising the content backlog accordingly.

Source: Search Engine Roundtable, September 2026 Google webmaster report · Read the entry

Crawlers high impact

Cloudflare now writes your robots.txt, and "no training" is the default for many sites.

What changed

Cloudflare launched Bot Preference Sync on 21 August: your robots.txt is generated from three switches in the dashboard (search, agents, training). Sites that disallow training get a no-training directive, and crawlers that don't meet Cloudflare's transparency standards are blocked at the edge on those sites. Ad-monetised domains get "disallow training" as the default.

Why it matters, and what we're doing

Why it matters

If your site sits behind Cloudflare, your AI crawler policy may have changed without anyone touching it. The answering bots, the ones that fetch your pages to build a recommendation, are the ones you can't afford to lose, and whether they keep access now depends on a setting and on the crawler's own behaviour.

What we're doing

We're checking the Cloudflare settings and the live robots.txt of every client this month, keeping search and agent access open, and recording the state in each site's health check so a silent change shows up next month.

Source: Cloudflare blog, "Say it once: introducing Bot Preference Sync" · Read the entry

Shopping medium impact

AI-referred shoppers now convert better than everyone else, and a third of product pages are unreadable to AI.

What changed

Adobe's Q2 2026 AI traffic report found traffic from AI sources to US retail sites up 393% year on year in the first quarter, and by March converting 42% better than non-AI traffic, having converted 38% worse a year earlier. Its first retailer readability analysis found only 66% of product pages and 74% of category pages fully readable by AI.

Why it matters, and what we're doing

Why it matters

AI referrals are still a small share of visits, but they're the most valuable share, and the gap between retailers whose pages AI assistants can read and those they can't is where the recommendation is decided.

What we're doing

Every retail client's monthly read now includes AI referral sessions and their conversion rate from GA4, and product and category page readability is in the diagnosis for any new engagement.

Source: Adobe Digital Insights, Q2 2026 AI Traffic Report · Read the entry

ChatGPT medium impact

OpenAI retired Instant Checkout. ChatGPT now finds the product; your site makes the sale.

What changed

Five months after launching it, OpenAI switched off Instant Checkout inside ChatGPT on 6 March and refocused on product discovery, with purchases completed on merchants' own sites and apps. Google's Universal Commerce Protocol and Perplexity's Instant Buy continue with agent-led checkout.

Why it matters, and what we're doing

Why it matters

For retailers this raises the stakes on the boring things: accurate product data, readable product pages, clear delivery and returns. ChatGPT decides whether to name you; your site has to close the sale it sends.

What we're doing

Retail clients' plans put product data and page readability ahead of any checkout integration, and we keep an eye on the Agentic Commerce Protocol so a single integration can be added when it pays.

Source: Agentic Commerce Feed, citing Digital Commerce 360, PYMNTS and Forrester · Read the entry

1 minute and you're ready, set, AEO.

Tell us about you and your business, and we'll kick things off immediately.

Start now Free assessment