AI crawlers, AI search and GEO for B2B websites
Practical guides on how ChatGPT, Claude, Perplexity and Google's AI read your website, and what to fix when they don't.
How to Track Traffic from ChatGPT and Other AI Assistants
GA4 now has an AI Assistant channel, and ChatGPT tags its links with utm_source=chatgpt.com. Here is how to measure AI referrals, and what analytics still misses.
What Is ClaudeBot? Anthropic's Crawlers Explained
ClaudeBot, Claude-SearchBot and Claude-User do different jobs. Learn what each Anthropic crawler does, how to verify it, and which ones a B2B website should allow.
The AI Crawler Directory: GPTBot, ClaudeBot, PerplexityBot and More
A reference list of AI crawlers and control tokens from OpenAI, Anthropic, Perplexity, Google, Apple, Meta and Common Crawl, with what each one does.
Why ChatGPT Doesn't Mention Your Company: 7 Technical Causes
When ChatGPT recommends competitors but not you, the cause is often technical. Seven common reasons B2B websites are invisible to AI, and how to check each one.
Is Your Firewall Blocking AI Search? How to Find Out
Security plugins, hosting firewalls and CDN bot protection often block AI crawlers without telling you. How to find these hidden 403 errors and fix them safely.
GEO vs SEO for Manufacturers: What Changes and What Doesn't
Generative engine optimization builds on SEO. What stays the same, what changes when buyers ask AI instead of Google, and what manufacturers should add first.
How AI Search Finds Suppliers: A B2B Buyer's Path
Follow a procurement question through an AI assistant, from prompt to shortlist, and see what a supplier's website needs at each step to be included.
What Is GPTBot? How OpenAI's Crawlers Read Your Website
GPTBot, OAI-SearchBot and ChatGPT-User do different jobs. Learn what each OpenAI crawler does, how to spot it in your logs, and which ones B2B sites should allow.
Should You Block AI Crawlers? A Guide for B2B Websites
Not all AI crawlers do the same job. Learn which ones affect AI search visibility, which only collect training data, and a sensible default for B2B websites.
robots.txt for AI Crawlers: Copy-Paste Examples
Ready-to-use robots.txt rules for GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot and Google-Extended, with the mistakes that block AI search by accident.
How to Check Which AI Crawlers Visit Your Website
Google Analytics can't see AI crawlers. Find GPTBot, ClaudeBot and PerplexityBot in your server logs, verify them, and spot blocked requests.
What Is an AI Visibility Tool? And What It Should Measure
AI visibility tools measure how AI assistants see your brand. The two main types, the metrics that matter for B2B, and what to ask before choosing.