Hi everyone, this is Neo.

What’s the most painful part of doing SEO? It’s not that the rules are strict — it’s that the rules are vague. Google says “content quality matters,” but what counts as high quality? Does content hidden behind an accordion count as “displayed”? What happens if you misspell a word in robots.txt? Are AI chatbots search engines? For years, all of these questions were answered by guesswork and tribal knowledge passed around the SEO community.

Not this week. Google put a whole set of long-vague rules down in writing in one go — and with the EU and Google each pushing from their own direction, the “rules of the game” in search suddenly got a whole lot clearer.

Today I’m walking you through 4 SEO developments from this week that independent site owners should care about, each with concrete action items. By the end, you’ll know exactly which SOPs need to change immediately.

1. Google officially says: content in accordions and tabs makes you less likely to be cited

This is the update with the most direct impact on day-to-day independent site operations.

Google updated its search snippet documentation with a new section on best practices for “Read more” deep links. Those are the links in search results that jump straight to a specific section of a page — and having them can earn your result more search real estate and more clicks.

Google listed 3 best practices:

1. Content must be immediately visible to humans when the page loads

Content hidden inside expandable sections (accordions) or tab interfaces reduces the chance of these deep links appearing.

2. Sections must use H2 or H3 headings Without a proper heading hierarchy, Google can’t recognize your content as distinct sections.

3. Snippet text must match what’s actually displayed on the page Content that only loads after scrolling or after user interaction further reduces the chance of deep links appearing.

Slobodan Manić, founder of NoHacks, hit the nail on the head in a LinkedIn comment:

“On the surface, this document is about one specific snippet behavior, but the language Google uses reads like a general preference. ‘Content immediately visible to humans’ is a structural directive, not a Read more-specific tip.”

In other words, Google is ostensibly talking about deep links, but it’s really saying something bigger: any content that requires a click to be seen is second-class in Google’s eyes.

Neo’s take: This one hits independent sites hard. I’ve audited tons of Shopify and WordPress sites, and at least 60% of independent sites bury their core content inside FAQ accordions, product spec tabs, and collapsed return-policy sections. These designs look clean in the UI — but to Google, that content simply doesn’t exist.

Immediate self-audit checklist:

• Is your product page’s “product details” inside a tab? (If so, at least show the core specs directly)
• Does your landing page FAQ use accordions? (Recommend expanding everything + H3 headings)
• Does your detail page lazy-load content only after scrolling halfway? (Core info must be above the fold)
• When your page loads, can visitors see your key selling points within 1 second?

There’s a deeper takeaway: these rules don’t just apply to Google Search — they apply to AI crawlers too. Manić pointed out that search crawlers and AI agents now face the same structural problem — the same audit standards. If your page is unfriendly to Google, it’s equally unfriendly to ChatGPT, Perplexity, and Claude.

2. Google may expand its list of unsupported robots.txt directives

This one’s more technical, but it’s important.

Gary Illyes and Martin Splitt revealed on the latest Search Off the Record podcast that Google’s team analyzed robots.txt files across millions of URLs in the HTTP Archive and identified the directives that are used most frequently but that Google doesn’t actually support.

Illyes said the team plans to document the 10–15 most-used unsupported directives beyond user-agent, allow, disallow, and sitemap.

What does this mean? Tons of independent sites have been writing directives into robots.txt for years, like:

• Crawl-delay (Google stopped supporting this long ago)
• Noindex (never supported — you must use meta robots)
• Host (only Yandex supports it)
• assorted custom directives

Google has never honored these — but we’ve all assumed they were working.

Illyes also mentioned a detail: Google’s parser already tolerates some misspellings of disallow and may tolerate more in the future. But he didn’t say which misspellings.

Neo’s take: This is an easy-to-miss optimization opportunity that costs almost nothing.

Do this now:

1. Open your robots.txt file and check it line by line
2. Flag anything that isn’t one of the 4 standard directives — user-agent/allow/disallow/sitemap
3. Fix typos immediately — don’t wait for Google’s parser to “tolerate” them, because:
   • First, you don’t know when (or if) it will
   • Second, other search engines’ crawlers may not be as lenient
4. If you want less noise, query the HTTP Archive data on BigQuery and compare your robots.txt against everyone else’s

The most important mindset shift: robots.txt doesn’t work just because you believe it works. Every directive needs to be verified.

3. The EU may force Google to share search data with competitors — including AI chatbots

This one might feel distant for Chinese independent site owners, but its long-term impact runs deep.

The European Commission issued its preliminary findings, proposing that Google must share search data with competing search engines across the EU and EEA — and crucially, including AI chatbots that qualify as “online search engines” under the Digital Markets Act (DMA).

The proposal covers 4 types of data, to be shared on fair, reasonable, and non-discriminatory terms:

1. Ranking data
2. Query data
3. Click data
4. View data

The public consultation runs until May 1, 2025, with a final decision expected by July 27, 2025.

Why does this matter so much?

If the EU insists on classifying “AI chatbots” as “search engines,” then Perplexity, ChatGPT Search, Claude, and other AI products could all get access to Google’s anonymized search data. That means:

1. AI search engines’ retrieval quality will improve fast — they’d train their retrieval systems on decades of Google’s accumulated data
2. Brands’ “AI citation distribution” will shift — previously dominated by web content, now potentially incorporating Google’s click/view signals
3. The legal boundary between “AI search” and “traditional search” gets formally dissolved

Neo’s take: Independent site owners in the EU should watch the July 27 final decision closely. But even if you don’t sell directly into the EU —

this regulatory framework is setting a global precedent for whether “AI search” legally counts as “search.”

Future regulations in the US, UK, and even China will cite the EU’s ruling. If a product is defined as a search engine in the EU, it faces a completely different set of rules on content copyright, data usage, and ad regulation.

My read: long-term, AI search citation distribution will look more and more like traditional ranking distribution. Which means the value of classic SEO skills isn’t disappearing — it’s migrating into the fight for “AI visibility.” Don’t rush to cut your SEO team; their skills are about to be reused.

4. Google doubles down on “task-based search” — users have even less reason to leave Google

The last one is the most anxiety-inducing for independent site owners: Google is letting users complete more and more tasks inside Google, so they never need to click your site at all.

This week’s updates:

1. Price tracking for individual hotels Google’s hotel price tracking used to work at the city level. Now you can track a specific hotel. Users flip a toggle in the search bar, and Google emails them when the price drops.

2. AI agents launched directly from AI Mode Users can now launch AI agents directly from AI Mode to execute tasks — theoretically covering restaurant bookings, tickets, finding services, comparison shopping, and a lot more.

Daniel Foley Carter’s LinkedIn comment cuts deep:

“Google’s AI Overviews, AI Mode, plus the new SERP+SITE embedded features — this is Google steadily eating away at traffic opportunities. Everything Google forbids us from doing, it does itself. Spammy/low-value content — it tells us not to rehash other people’s content, then goes and does exactly that.”

Google CEO Sundar Pichai previously described the vision of “search as an agent manager” in interviews — and this week, that vision is quietly shipping, one search-bar toggle at a time.

Neo’s take: This one’s anxiety-inducing, but the playbook is clear.

Real-world impact on independent sites:

1. E-commerce that relies on “price alerts” as a return trigger — Google is intercepting this traffic. Price-sensitive categories like hotels, flights, and electronics are hit first.
2. Hotel and local-service brands — you must fill out your Google Business Profile and hotel feeds completely, or you simply don’t exist inside Google’s embedded interfaces.
3. B2C independent sites — competing purely on “price notifications” has less and less room. Move toward membership programs, brand loyalty, and exclusive products — things Google can’t replicate.

What to do about it:

• Build off-platform reach: email marketing, SMS, WhatsApp Business — these are return channels Google can’t take away
• Strengthen branded search: when users search your brand name directly, Google basically has to show your official site — it can’t intercept that
• Do what Google can’t: custom services, expert consultation, community engagement, exclusive member perks
• Build an owned audience: as public traffic gets consumed by Google, your owned audience is your stronghold

This week’s core theme: the rules are being written down

These 4 stories look scattered, but they share one theme:

Rules that used to be vague, implicit, and passed around by word of mouth are being written down in black and white.

Google announced it will expand the documented unsupported robots.txt directives, published concrete best practices for Read more deep links, the EU proposed classifying AI chatbots as search engines, and Pichai’s “agent manager” vision is shipping as search-bar toggles —

every one of these turns something that used to be fuzzy into something that’s now clear.

For independent site operators, this is a double-edged sword:

The upside:

• Clearer audit standards — no more guessing
• Clearer optimization direction — no more detours
• Rules in writing — at least you now have something to cite in an appeal

The downside:

• Things you used to defend with “we weren’t sure at the time” are now indefensible
• The gap between laggard sites and leaders will widen
• Less and less room for regulatory arbitrage

Neo’s take: Every time the SEO/content ecosystem’s “rules get clarified,” it’s a small reshuffle. Sites that have been doing the right thing all along benefit naturally; sites that make money off gray areas, information asymmetries, and manipulation tricks will be forced to level up or die out. That’s a good thing — it gives people who genuinely invest in content and user experience more stable returns.

Summary

This week’s 4 key SEO developments and action items:

| Development | Action |