Atalaya AI crawler check

com.atalaya-ai/ai-crawler-check · v1.0.0 · search-and-web

Atalaya AI crawler check is healthy: it completed an MCP handshake in 830 ms and exposes 2 tools.

Which AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why.

Endpoint: https://atalaya-ai.com/mcp (streamable-http)

No repository listed · Website · JSON · Add to my inventory

Facts

Users (last 30 days)0
HandshakeHealthy
Auth neededNone
Tool count2
Latency830 ms
Last checked (UTC)2026-11-03T20:25:28.619Z

Health history

Checked (UTC)StatusLatencyError
2026-11-03T20:25:28.619ZHealthy830

Tools (2)

check_ai_crawler_accessChecks whether AI crawlers can reach and read a public website or web app: which AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended and more) robots.txt allows and the exact rule for each, how much text the homepage HTML carries for crawlers that do not run J
list_ai_crawlersLists the AI crawler user-agent tokens Atalaya checks, by vendor and purpose (training, search index, user-triggered fetch), so you can write a robots.txt that keeps AI search while opting out of training.