nytimes.com
The New York Times - Breaking News, US News, World News and Videos
Category Scores
All 17 Checks
robots.txt blocks 8 AI crawlers: GPTBot, ChatGPT-User, anthropic-ai, Claude-Web, CCBot, Google-Extended, PerplexityBot, Bytespider
Page is open to indexing by AI agents
Server-rendered HTML contains ~1728 words of text content
Headings: 1 H1, 15 H2, 6 H3. Semantic elements: main, nav, article, section, header, footer
Found structured data: JSON-LD, RDFa
Text-to-HTML ratio: 1% (12KB text / 1169KB total)
No FAQ schema or FAQ content detected
No llms.txt file found at site root
~1376 extractable words, <main> element found
Entity signals found: page title, meta description, Schema.org data
No MCP server manifest found (optional — for sites that expose tools to AI agents)
E-E-A-T signals found: byline, expertise signals
Page loaded in 300ms
1 blocking script, 8 stylesheets in <head>
OG tags — Title: yes, Description: yes, Image: yes, Type: yes
Meta description: 267 chars (too long)
Freshness signals: <time> elements, Last-Modified header