Crawlie
app.crawlie/crawlie
Technical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs.
Yes, once you sign in.The endpoint is live and speaks MCP correctly. You'll need to sign in with your account (OAuth) to use its tools.
Connect it
Settings → Connectors → Add custom connector
URL: https://crawlie.app/mcpSettings → Apps & Connectors → Advanced → Developer mode
Create connector with URL: https://crawlie.app/mcp{
"mcpServers": {
"crawlie": {
"url": "https://crawlie.app/mcp"
}
}
}claude mcp add --transport http crawlie https://crawlie.app/mcp{
"servers": {
"crawlie": {
"type": "http",
"url": "https://crawlie.app/mcp"
}
}
}Tools
This server requires sign-in before it lists its tools. Vendors can share a read-only token with us to publish a verified tool list. Learn more.
Alternatives in Browser & Scraping
Compare →BRBrowserlessB
Official Browserless MCP server: browser automation, scraping, screenshots and PDFs for AI agents.
BRBrowserstackB
BrowserStack's Official MCP Server
SupadataB
Video transcripts, metadata and structured data from YouTube, TikTok, Instagram, X; web scraping.
Slack MCP ServerB
Catch up on Slack without reading it. Unreads, threads, search. Browser-session or hosted OAuth.
cloroB
Scrape AI answer engines and Google Search/News with country and state-level geo-targeting.
PDpdfrenderB
HTML and CSS to PDF MCP server with page headers, footers and page numbers. No headless browser.