Agent Readiness API
POST any URL. Get back a 0-100 AI-readiness score across 18 standards — robots.txt, llms.txt, MCP server card, /.well-known/api-catalog, OAuth discovery, x402, Content Signals, and 12 more. Free for everyone, MCP-ready for agents.
curl -X POST https://www.startuphub.ai/api/agent-readiness/scan \
-H "Content-Type: application/json" \
-d '{ "url": "https://example.com" }'How it works
One POST. 18 checks in parallel. Ready-to-paste fix prompts.
POST a URL
Send { url } to /api/agent-readiness/scan. No auth needed for the public scan; rate-limited 10 scans / 10 min / IP. Or call scan_agent_readiness via MCP.
We run 18 checks in parallel
robots.txt, llms.txt, MCP server card, /.well-known/api-catalog, OAuth discovery, x402 payment endpoint, Content Signals, markdown content negotiation, schema.org markup, and 9 more standards.
Get a 0-100 score + per-check breakdown
Response includes the overall score, every check's pass/fail/partial state, and a copy-paste fix prompt for each failure — drop into Claude / ChatGPT to remediate.
The 18 checks
Every standard the scanner runs against your URL, with weights driving the 0-100 score.
robots.txtStandard crawler directives + AI-bot allowlists (GPTBot, Claude-User, Perplexity, etc.)
llms.txtAnthropic-proposed standard for LLM-friendly site summaries.
llms-full.txtExtended llms.txt with full content for ingestion crawlers.
MCP server card/.well-known/mcp-server.json — does the site advertise an MCP endpoint?
API catalog/.well-known/api-catalog — RFC 9727 machine-readable API directory.
OAuth discovery/.well-known/oauth-protected-resource for agent-friendly auth.
x402 payment endpointL402 / x402 micropayment readiness for agent commerce.
Content SignalsCloudflare Content Signals — train / search / ai-input policy directives.
Markdown content negotiationDoes the site serve text/markdown when the Accept header asks for it?
sitemap.xmlDiscoverability for indexing crawlers.
OpenGraph + Twitter cardsSurface metadata for social agents.
Schema.org JSON-LDStructured data — Organization, Product, FAQPage, etc.
Canonical URLsPrevents duplicate-ingestion from query-string variants.
HTTPS + HSTSTrust signal that AI agents check before transacting.
AI-bot rate limitsDetects 429s / Cloudflare blocks against known AI crawler IPs.
Cookie wall detectionAgents can't consent — pages behind cookie walls fail to index.
JavaScript-only contentPages that need JS to render miss most AI ingestion crawlers.
Server-side renderingConfirms first-byte HTML contains the visible content.
Response shape
Score + category breakdown + per-check status + copy-paste fix prompts.
{
"url": "https://example.com",
"score": 38,
"category_scores": {
"discoverability": 60,
"ai_metadata": 20,
"agent_protocols": 15,
"auth_payment": 50
},
"checks": [
{ "id": "llms_txt", "status": "fail", "weight": 8 },
{ "id": "mcp_card", "status": "fail", "weight": 10 },
{ "id": "robots_txt","status": "pass", "weight": 4 }
/* ... 15 more ... */
],
"fixes": [
{
"check": "llms_txt",
"prompt": "Generate an llms.txt for example.com. Include..."
}
/* ... per failed check ... */
]
}Built for these workflows
Real production patterns from teams using the scanner today.
Pre-launch audit
Run before shipping a marketing site. Catch missing llms.txt, broken MCP cards, and AI-bot blocks before traffic ramps. Free unlimited self-checks via MCP.
Outbound prospecting
Score 50 prospect sites in a batch. The lowest scores are your best leads — they need help. Pair with discover_email to send personalised outreach.
Agency dashboards
Embed the score on a client portal as a real-time AI-readiness KPI. Track improvement month-over-month as standards evolve.
Agent self-checks
In an agent loop building or hosting a site, periodically scan the site's own readiness. Ship a report with the score + remediation prompts.
Score your site now
Free. No signup. No credits charged.