MCP servers
polite-crawler
A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.
Remotes
This server publishes no hosted endpoint. Run one of its packages locally.
Packages
polite-crawler-mcp · npm 0.5.2 · stdio
claude mcp add --transport stdio polite-crawler -- npx -y polite-crawler-mcp@0.5.2Server details
- Registry name
- io.github.mark1russell7/polite-crawler
- Version
- 0.5.2
- Registry status
- active
- Repository
- mark1russell7/crawler
- Website
- mark1russell7.github.io
- First published
- Source
