Can ChatGPT see your site?
See what AI crawlers and agents actually get: robots.txt rules for GPTBot, ClaudeBot and seven more, llms.txt, structured data, MCP, and pages that need JavaScript. 13 checks, graded A–F.
What you get
sample · stripe.com
What we check
It measures how well a website works for AI systems — crawlers that power AI answers, assistants that cite sources, and agents that browse on behalf of users. We check 13 signals across crawlability, discovery and AI specs, then grade the result A–F out of 100.
llms.txt is a plain-text file at your site’s root (like robots.txt) that gives language models a curated map: what your site is, which pages matter, and how you want to be described. It takes minutes to add and stops AI systems from guessing.
Depends on your business. Blocking keeps content out of AI training and AI answers — which also makes you invisible where a growing share of discovery happens. Many sites allow citation crawlers and block pure training bots. Whatever you choose, it should be deliberate — and monitored, because a deploy can silently rewrite robots.txt.
An open protocol that lets AI assistants connect to services as tools — reading data and taking actions with the user’s permission. A site with an MCP manifest isn’t just visible to AI; it’s usable by it.
Most AI crawlers and agents don’t execute JavaScript — they read the raw HTML your server returns. If your page renders everything client-side, AI systems see a blank shell. Server-side rendering or pre-rendering fixes it (and helps SEO and performance too).
Highest impact first: unblock the AI crawlers you actually want, serve real content without JavaScript, add JSON-LD structured data, publish a sitemap and RSS feed, and add llms.txt. If you offer an API, publish an OpenAPI spec and MCP manifest so agents can use it directly.
Yes. Add the site as a free monitor with AI readiness tracking on and we re-check it daily, then email you when robots.txt starts blocking an AI crawler, llms.txt or agents.txt disappears, or the grade changes.
Free plan
Get told before it breaks.
Monitoring re-checks your site’s AI readiness every day and emails you when a deploy blocks an AI crawler or removes llms.txt — alongside uptime and security alerts.
1 monitor, checked every 10 seconds
From six locations, confirmed before we alert, so no false alarms.
Certificate expiry alerts
Email 30, 14 and 7 days before it runs out.
Security scans and change alerts
Certificate, chain, headers, DNS and email security, with an email when anything changes.
Cloudflare offline page
Visitors see a status page instead of an error while you fix it.
12 months of history
Every check, change and incident, kept for a year.
Slack, JIRA, Linear and Teams
Send alerts where your team already works.