Loading…
Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
TheCrawler is an MCP server entry in ChatHome Skills, sourced from Official MCP Registry and scored 64/100. As a Model Context Protocol server, it exposes tools that MCP-compatible LLM clients such as Claude, Cursor, and Copilot can call directly, extending an agent's reach beyond its built-in capabilities. ChatHome Skills discovered this entry through its daily ingest of official registries and GitHub discovery queries, and re-verifies repository facts, freshness signals, and install metadata on every run. The quality score weighs official-registry presence, a working install command, license clarity, GitHub star trajectory, and repository freshness — the full formula is on the Sources page. The install command above is ready to copy. Review the last-pushed date and repository status before adding TheCrawler to a production agent workflow; the snapshot facts below are point-in-time values from the most recent ingest.
npx -y thecrawler@0.5.8Review the upstream source before running this command.
{
"_meta": {
"io.modelcontextprotocol.registry/official": {
"status": "active",
"isLatest": true,
"updatedAt": "2026-07-02T20:00:08.332423Z",
"publishedAt": "2026-07-02T20:00:08.332423Z",
"statusChangedAt": "2026-07-02T20:00:08.332423Z"
}
},
"server": {
"name": "io.github.manchittlab/thecrawler",
"title": "TheCrawler",
"$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
"version": "0.5.8",
"packages": [
{
"version": "0.5.8",
"transport": {
"type": "stdio"
},
"identifier": "thecrawler",
"registryType": "npm"
}
],
"repository": {
"url": "https://github.com/manchittlab/TheCrawler",
"source": "github"
},
"description": "Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support."
}
}