io.github.77777R7/octocrawl

io.github.77777R7/octocrawl · v0.4.2 · search-and-web

io.github.77777R7/octocrawl is healthy: it completed an MCP handshake in 1017 ms and exposes 2 tools. It scores 67/100.

Web scraper for agents: blocked, empty and wrong pages reported as such, with an Evidence Record.

Endpoint: https://mcp.octocrawl.dev/mcp (streamable-http)

Repository · Website · JSON · Add to my inventory

Score 67/100

health21.9 / 25
authEase15 / 15
toolQuality15 / 15
maintenance7 / 15
adoption0 / 10
usage0 / 10
security8 / 10

Scoring v0.3, computed 2026-10-15T00:30:57.540Z.

Health history

Checked (UTC)StatusLatencyError
2026-10-15T00:30:49.077ZHealthy1017

Tools (2)

scrapeFetch one URL through the Octocrawl coverage ladder. Compact by default; set debug=true for the full audit. The result's warnings name what its content cannot vouch for: robots_overridden (robots.txt disallows the URL; a local server fetched it because you named it), or client_rendered_suspected whe
mapList a site's URLs without fetching each page: the start URL, the links on its page (read on the http lane alone; no browser) and the entries of the sitemaps the site declares (robots.txt Sitemap: lines, else /sitemap.xml), inside one deadline. Every URL is in the crawl's scope (the start host and i