io.github.cyanheads/evals-mcp-server

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

What does this entry provide?

io.github.cyanheads/evals-mcp-server is an MCP server entry in ChatHome Skills, sourced from Official MCP Registry and scored 78/100. As a Model Context Protocol server, it exposes tools that MCP-compatible LLM clients such as Claude, Cursor, and Copilot can call directly, extending an agent's reach beyond its built-in capabilities. ChatHome Skills discovered this entry through its daily ingest of official registries and GitHub discovery queries, and re-verifies repository facts, freshness signals, and install metadata on every run. The quality score weighs official-registry presence, a working install command, license clarity, GitHub star trajectory, and repository freshness — the full formula is on the Sources page. The install command above is ready to copy. Review the last-pushed date and repository status before adding io.github.cyanheads/evals-mcp-server to a production agent workflow; the snapshot facts below are point-in-time values from the most recent ingest.

Snapshot facts

Source: Official MCP Registry
Quality: 78/100
Install method: npm
Repo: cyanheads/evals-mcp-server
Repo updated: Oct 13, 2026

Install command

npx -y @cyanheads/evals-mcp-server@0.1.6

Install method: npm

Review the upstream source before running this command.

GitHub project

Quality

Repo stars

Repo updated

Oct 13, 2026

How is this score calculated?

Weighted across six dimensions, scored 0-100.
Provenance (25): listed in an official or curated registry.
Installability (25): a runnable install command beats a declared transport, which beats a source checkout.
Maintenance (20): recency of the last push; archived entries score zero here.
Adoption (20): repository stars on a log curve.

MCP manifest

{
  "_meta": {
    "io.modelcontextprotocol.registry/official": {
      "status": "active",
      "isLatest": true,
      "updatedAt": "2026-10-13T12:35:36.853835Z",
      "publishedAt": "2026-10-13T12:35:36.853835Z",
      "statusChangedAt": "2026-10-13T12:35:36.853835Z"
    }
  },
  "server": {
    "name": "io.github.cyanheads/evals-mcp-server",
    "$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
    "version": "0.1.6",
    "packages": [
      {
        "version": "0.1.6",
        "transport": {
          "type": "stdio"
        },
        "identifier": "@cyanheads/evals-mcp-server",
        "runtimeHint": "npx",
        "registryType": "npm",
        "registryBaseUrl": "https://registry.npmjs.org",
        "environmentVariables": [
          {
            "name": "EVALS_DATA_DIR",
            "format": "string",
            "default": "./evals-data",
            "description": "Root folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it."
          },
          {
            "name": "EVALS_REQUIRE_CONFIRMATION",
            "format": "string",
            "default": "false",
            "description": "When 'true', evals_submit_draft requests human confirmation before finalizing."
          },
          {
            "name": "EVALS_DEFAULT_LICENSE",
            "format": "string",
            "description": "Default metadata.license applied when a draft omits one."
          },
          {
            "name": "EVALS_CAPTURE_DIR",
            "format": "string",
            "description": "Directory of framework-written tool-call captures; when set, captures EvalsIDs resolve to full dumps."
          },
          {
            "name": "MCP_LOG_LEVEL",
            "format": "string",
            "default": "info",
            "description": "Sets the minimum log level for output (e.g., 'debug', 'info', 'warn')."
          }
        ]
      },
      {
        "version": "0.1.6",
        "transport": {
          "url": "http://localhost:3010/mcp",
          "type": "streamable-http"
        },
        "identifier": "@cyanheads/evals-mcp-server",
        "runtimeHint": "npx",
        "registryType": "npm",
        "registryBaseUrl": "https://registry.npmjs.org",
        "environmentVariables": [
          {
            "name": "MCP_TRANSPORT_TYPE",
            "value": "http",
            "format": "string",
            "description": "Selects the HTTP transport."
          },
          {
            "name": "MCP_HTTP_HOST",
            "format": "string",
            "default": "127.0.0.1",
            "description": "The hostname for the HTTP server."
          },
          {
            "name": "MCP_HTTP_PORT",
            "format": "string",
            "default": "3010",
            "description": "The port to run the HTTP server on."
          },
          {
            "name": "MCP_HTTP_ENDPOINT_PATH",
            "format": "string",
            "default": "/mcp",
            "description": "The endpoint path for the MCP server."
          },
          {
            "name": "MCP_AUTH_MODE",
            "format": "string",
            "default": "none",
            "description": "Authentication mode to use: 'none', 'jwt', or 'oauth'."
          },
          {
            "name": "EVALS_DATA_DIR",
            "format": "string",
            "default": "./evals-data",
            "description": "Root folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it."
          },
          {
            "name": "EVALS_REQUIRE_CONFIRMATION",
            "format": "string",
            "default": "false",
            "description": "When 'true', evals_submit_draft requests human confirmation before finalizing."
          },
          {
            "name": "EVALS_DEFAULT_LICENSE",
            "format": "string",
            "description": "Default metadata.license applied when a draft omits one."
          },
          {
            "name": "EVALS_CAPTURE_DIR",
            "format": "string",
            "description": "Directory of framework-written tool-call captures; when set, captures EvalsIDs resolve to full dumps."
          },
          {
            "name": "MCP_LOG_LEVEL",
            "format": "string",
            "default": "info",
            "description": "Sets the minimum log level for output (e.g., 'debug', 'info', 'warn')."
          }
        ]
      }
    ],
    "repository": {
      "url": "https://github.com/cyanheads/evals-mcp-server",
      "source": "github"
    },
    "description": "Author verifiable eval records through a draft→review→revise→submit loop with enforced graders."
  }
}

Report an issue with this listing