AI Content Visibility: Can AI Crawlers See Your Content?
How JavaScript rendering affects what AI bots can see on your page.
What it measures
AI Content Visibility checks whether your content is available in the raw HTML that AI crawlers download, or whether it requires JavaScript to render. Most AI bots (GPTBot, ClaudeBot, PerplexityBot) don't execute JavaScript — they only read what the server sends.
Why it matters for AI
About 80% of AI crawl traffic comes from bots that don't execute JavaScript. If your site is built with React, Vue, Angular, or another JS framework without server-side rendering, your content may be completely invisible to these crawlers. Only deep crawlers like Googlebot run a headless browser.
| Crawler | Used by | Reads JS? |
|---|---|---|
| GPTBot | ChatGPT / OpenAI | ❌ No |
| ClaudeBot | Claude / Anthropic | ❌ No |
| PerplexityBot | Perplexity | ❌ No |
| Googlebot | Google AI / Gemini | ✅ Yes |
| Bingbot | Copilot / Bing | ✅ Yes |
How to improve
- Enable Server-Side Rendering (SSR) — Your framework (Next.js, Nuxt, SvelteKit) likely supports this out of the box
- Use pre-rendering services — Services like Prerender.io generate static HTML snapshots for crawlers
- Test without JavaScript — Disable JS in your browser to see what AI bots actually get
- Consider static site generation (SSG) — For content that doesn't change often, SSG is the most crawler-friendly option
💡 Quick win
Disable JavaScript in your browser and reload your page. If the main content disappears, you have a visibility problem that needs SSR.