AI Crawler Checker — Robots.txt Policy for Six Bots

Check declared robots.txt permissions for six AI crawlers at URL paths

What does this entry provide?

AI Crawler Checker — Robots.txt Policy for Six Bots is an MCP server entry in ChatHome Skills, sourced from Official MCP Registry and scored 97/100. As a Model Context Protocol server, it exposes tools that MCP-compatible LLM clients such as Claude, Cursor, and Copilot can call directly, extending an agent's reach beyond its built-in capabilities. ChatHome Skills discovered this entry through its daily ingest of official registries and GitHub discovery queries, and re-verifies repository facts, freshness signals, and install metadata on every run. The quality score weighs official-registry presence, a working install command, license clarity, GitHub star trajectory, and repository freshness — the full formula is on the Sources page. The install command above is ready to copy. Review the last-pushed date and repository status before adding AI Crawler Checker — Robots.txt Policy for Six Bots to a production agent workflow; the snapshot facts below are point-in-time values from the most recent ingest.

Snapshot facts

Source: Official MCP Registry
Quality: 97/100
Install method: streamable-http
Repo: Registry only
Repo updated: Nov 3, 2026

Install command

mcp add io.github.kriton-dev/ai-crawler-access-check https://mcp.apify.com/?tools=hermeskd/ai-crawler-access-check

Install method: streamable-http

Review the upstream source before running this command.

Source entry

Quality

Repo stars

Repo updated

Nov 3, 2026

How is this score calculated?

Weighted across six dimensions, scored 0-100.
Provenance (25): listed in an official or curated registry.
Installability (25): a runnable install command beats a declared transport, which beats a source checkout.
Maintenance (20): recency of the last push; archived entries score zero here.
Adoption (20): repository stars on a log curve.

MCP manifest

{
  "_meta": {
    "io.modelcontextprotocol.registry/official": {
      "status": "active",
      "isLatest": true,
      "updatedAt": "2026-11-03T13:07:32.272621Z",
      "publishedAt": "2026-11-03T13:07:32.272621Z",
      "statusChangedAt": "2026-11-03T13:07:32.272621Z"
    }
  },
  "server": {
    "name": "io.github.kriton-dev/ai-crawler-access-check",
    "_meta": {
      "io.modelcontextprotocol.registry/publisher-provided": {
        "apifyActor": "hermeskd/ai-crawler-access-check",
        "storeTitle": "AI Crawler Checker — Robots.txt Policy for Six Bots",
        "storeDescription": "AI crawler checker: declared robots.txt permissions for six fixed AI bots at a URL path, without fetching the page. $0.0015 per path; start extra; usage included; failed results uncharged."
      }
    },
    "title": "AI Crawler Checker — Robots.txt Policy for Six Bots",
    "$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
    "remotes": [
      {
        "url": "https://mcp.apify.com/?tools=hermeskd/ai-crawler-access-check",
        "type": "streamable-http",
        "headers": [
          {
            "name": "Authorization",
            "isSecret": true,
            "description": "Optional: 'Bearer <your Apify API token>'. MCP clients that support OAuth can sign in to Apify instead. Runs are billed to your Apify account at the pay-per-event prices on the Actor's store page."
          }
        ]
      }
    ],
    "version": "1.0.2",
    "websiteUrl": "https://apify.com/hermeskd/ai-crawler-access-check",
    "description": "Check declared robots.txt permissions for six AI crawlers at URL paths"
  }
}

Report an issue with this listing