Siteiz
Check which AI crawlers a site allows and see pages the way AI crawlers do. Free, read-only.
Connect it
Settings → Connectors → Add custom connector
URL: https://siteiz.com/mcpSettings → Apps & Connectors → Advanced → Developer mode
Create connector with URL: https://siteiz.com/mcp{
"mcpServers": {
"siteiz": {
"url": "https://siteiz.com/mcp"
}
}
}claude mcp add --transport http siteiz https://siteiz.com/mcp{
"servers": {
"siteiz": {
"type": "http",
"url": "https://siteiz.com/mcp"
}
}
}4 tools, verified live
check_ai_crawlersread-onlyReads a website's robots.txt and reports, for 11 AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended, Meta-ExternalAgent, CCBot, Bytespider), whether each may reach the given page. Separates AI search crawlers (decide if the site appears in ChatGPT, Claude and Perplexity answers) from training crawlers. Also reports llms.
view_page_as_ai_crawlerread-onlyFetches one page the way most AI crawlers do (plain HTTP, no JavaScript) and reports what they actually receive: title, meta description, canonical, H1, heading count, structured data types, visible word count, token reading cost, and a text preview. Use it to check whether content is visible to AI without JavaScript.
explain_ai_crawlerread-onlyExplains what an AI crawler user agent does (operator, purpose, and what blocking it in robots.txt changes). Pass a name such as GPTBot or OAI-SearchBot, or omit it to list all crawlers Siteiz tracks.
get_ai_visibility_reportread-onlyReturns a published, dated Siteiz AI visibility report for a well-known company's homepage (score, grade, pillar scores, top issues). Omit the company to list all published reports.
Alternatives in Browser & Scraping
Compare →
PlayDropB
Publish, test and share browser games on PlayDrop from your AI agent.
ReplyNodesB
Web MCP: scrape/crawl sites, web search, brand assets, app stores, YouTube, Reddit, Hacker News.
SNSnapforgeB
Screenshots, PDFs and Markdown from any URL or HTML for AI agents, via the SnapForge API
SHShotsB
Create App Store screenshots, icons, ASO copy, localization, and revisions via hosted MCP.
DEDesignforyouB
Generate logos, social posts, app screenshots, comic panels & visual-novel assets from prompts.
Atlas Web Compiler & ScraperB
Deterministic Zero-LLM Web Compiler, Scraper, Crawler, and Site Mapper for AI Agents.