WC
Web Crawler MCP by InsightfulPipe
com.insightfulpipe/crawler
Hosted Web Crawler MCP server for Claude, ChatGPT and Cursor, with each action switched per account.
Yes, once you sign in.The endpoint is live and speaks MCP correctly. You'll need to sign in with your account (OAuth) to use its tools.
Is this your server? Claim the listing. Verified adds a vendor-confirmed mark on this page and matching app pages.
Claim with Verified — $49/moWant it in front of people comparing Browser & Scraping tools? Feature it — $149/mo
Connect it
Settings → Connectors → Add custom connector
URL: https://crawler.insightfulmcp.com/Settings → Apps & Connectors → Advanced → Developer mode
Create connector with URL: https://crawler.insightfulmcp.com/{
"mcpServers": {
"crawler": {
"url": "https://crawler.insightfulmcp.com/"
}
}
}claude mcp add --transport http crawler https://crawler.insightfulmcp.com/{
"servers": {
"crawler": {
"type": "http",
"url": "https://crawler.insightfulmcp.com/"
}
}
}Tools
This server requires sign-in before it lists its tools.
Alternatives in Browser & Scraping
Compare →
Mimiq: AI agents use your app like your users and find what breaksB
AI agents use your app like your users, in real browsers, and report what is broken or confusing.
ReplyNodesB
Web MCP: scrape/crawl sites, web search, brand assets, app stores, YouTube, Reddit, Hacker News.
CrawlieB
Technical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs.
WSWeb Scraping MCP ServerB
Generic URL crawl + HTML extraction — fallback for sites without dedicated MCPs.
SWSeo Web Analysis MCP ServerB
Site crawl + tech stack + DNS + SSL + WHOIS — five web-intel layers in one MCP.
PMPlaywright MCP ServerB
Headless browser primitives for AI agents when sites need real JS rendering.