Technical guides.

Crawler access, rendering, structured data and site health for AI search.

65 articles, newest first

AI Search

NLWeb: What It Is and Who Should Care

NLWeb explained without the hype: what Microsoft's open project documents, what it does not prove, and a plain test for whether your site should adopt it now.

Olga Kunger 12 min read
Technical

Server Side Rendering: SEO Trade-Offs

Server side rendering vs static generation vs client rendering for Google and AI crawlers, with a decision rule by site type and a test you can run today.

Olga Kunger 12 min read
AI Search

CCBot and Common Crawl: Allow or Block?

CCBot feeds Common Crawl, a dataset behind many AI models. See what blocking it changes, what it does not, and how to verify real CCBot visits in your logs.

Olga Kunger 14 min read
AI Search

GPTBot vs OAI-SearchBot vs ChatGPT-User

GPTBot, OAI-SearchBot and ChatGPT-User do three different jobs. See which one controls ChatGPT search visibility and the robots.txt rules for each goal.

Olga Kunger 12 min read
Technical

Redirect Loops: Find and Fix Them Fast

Redirect loops send browsers in circles. Find which rule loops with curl, then fix the HTTPS, www, trailing slash, plugin or CDN cause behind it.

Olga Kunger 15 min read
Technical

410 Gone: When to Use It Instead of 404

410 Gone tells clients a page was removed on purpose. See when a 410 beats a 404, how Google treats both, and the exact Apache and nginx rules to serve one.

Olga Kunger 13 min read
GEO

What Is llms.txt (and Is It Worth Building)?

llms.txt explained: what the proposed file is, who proposed it, whether any AI engine actually reads it yet, how to build one, and when to skip it.

Olga Kunger 4 min read

Want this done for your site?

Every engagement starts with a free visibility audit, so we agree on the baseline before anyone writes code.