Loading…
robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.
Robots.txt & AI Crawler Checker is an MCP server entry in ChatHome Skills, sourced from Official MCP Registry and scored 100/100. As a Model Context Protocol server, it exposes tools that MCP-compatible LLM clients such as Claude, Cursor, and Copilot can call directly, extending an agent's reach beyond its built-in capabilities. ChatHome Skills discovered this entry through its daily ingest of official registries and GitHub discovery queries, and re-verifies repository facts, freshness signals, and install metadata on every run. The quality score weighs official-registry presence, a working install command, license clarity, GitHub star trajectory, and repository freshness — the full formula is on the Sources page. The install command above is ready to copy. Review the last-pushed date and repository status before adding Robots.txt & AI Crawler Checker to a production agent workflow; the snapshot facts below are point-in-time values from the most recent ingest.
mcp add dev.workers.quietworklabs.robots-check/robots-check https://robots-check.quietworklabs.workers.dev/mcpReview the upstream source before running this command.
{
"_meta": {
"io.modelcontextprotocol.registry/official": {
"status": "active",
"isLatest": true,
"updatedAt": "2026-10-18T03:32:52.238228Z",
"publishedAt": "2026-10-18T03:32:52.238228Z",
"statusChangedAt": "2026-10-18T03:32:52.238228Z"
}
},
"server": {
"name": "dev.workers.quietworklabs.robots-check/robots-check",
"title": "Robots.txt & AI Crawler Checker",
"$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
"remotes": [
{
"url": "https://robots-check.quietworklabs.workers.dev/mcp",
"type": "streamable-http"
}
],
"version": "1.0.0",
"websiteUrl": "https://robots-check.quietworklabs.workers.dev/",
"description": "robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check."
}
}