Security alerts WordPress 7.1.4 · no-login code execution in the updater 117 critical WordPress plugin CVEs · in October, most need no login

AI readiness checker

Can ChatGPT see your site?

See what AI crawlers and agents actually get: robots.txt rules for GPTBot, ClaudeBot and seven more, llms.txt, structured data, MCP, and pages that need JavaScript. 13 checks, graded A–F.

F
AI Readiness
10/100
nytimes.com
1 of 13 checks passing
Crawlability
0/3
Discovery
1/3
AI Specs
0/7

AI can barely see this site

  • robots.txt starts blocking GPTBot, ClaudeBot and others
  • llms.txt or agents.txt disappears
  • Structured data (JSON-LD) removed
  • AI readiness grade drops

Free account · no credit card · we never share your email

Crawlability

0/40 pts
AI crawlers allowed in robots.txt 0/15

Every major AI crawler is blocked — the site is invisible to AI answers and agents.

Content readable without JavaScript 0/15

~10 words visible without JavaScript. The page is effectively blank to non-rendering agents (most of them).

Homepage reachable by automated clients 0/10

Automated clients get HTTP 403 — AI agents are being turned away at the door.

Discovery

10/30 pts
JSON-LD structured data 0/12

No valid JSON-LD found on the homepage. AI systems have to guess what your site is about.

XML sitemap 10/10

Declared in robots.txt.

RSS/Atom feed 0/8

No feed advertised or found at /feed or /rss.xml. Feeds are the cheapest machine-readable channel you can offer.

AI Specs

0/30 pts
llms.txt 0/10

Not found. llms.txt tells AI models which of your pages matter and how to describe you.

Markdown content negotiation 0/4

Requests with Accept: text/markdown still get HTML. Serving Markdown saves agents ~10× the tokens.

OpenAPI specification 0/4

No OpenAPI spec at /openapi.json or /openapi.yaml.

MCP endpoint 0/4

No MCP manifest (/.well-known/mcp.json, /.well-known/mcp/server-card.json) or live /mcp endpoint. MCP is how AI assistants plug into services directly.

ai-plugin.json manifest 0/3

No /.well-known/ai-plugin.json manifest.

agents.txt 0/3

Not found at /agents.txt or /.well-known/agents.txt — an emerging convention for telling AI agents how to interact with your site.

x402 machine payments 0/2

No x402 support (HTTP-native payments for agents). Cutting-edge — very few sites have this.

AI crawler access (robots.txt)

Which AI systems your robots.txt lets in — blocked bots can’t read or cite your content.

GPTBot
OpenAI (ChatGPT training + search) · blocked
ClaudeBot
Anthropic (Claude) · blocked
Claude-User
Anthropic (user-initiated fetches) · blocked
PerplexityBot
Perplexity AI · blocked
Google-Extended
Google (Gemini training) · blocked
CCBot
Common Crawl (feeds many models) · blocked
Applebot-Extended
Apple Intelligence · blocked
meta-externalagent
Meta AI · blocked
Bytespider
ByteDance · blocked

The other half

Now check nytimes.com’s security grade.

SSL/TLS, security headers, DNSSEC, DMARC and more — the same A–F grading, free.