MeshKoreBot
Web crawler operated by MeshKore
Identity
- User-Agent
- MeshKoreBot/1.0 (+https://meshkore.com/bot; )
- Operator
- MeshKore
- Contact
Purpose
MeshKoreBot builds the MeshKore AI Agent Directory — a public, searchable index of open-source AI agents. We crawl GitHub, HuggingFace, PyPI, npm, and curated agent lists daily. All indexed data is publicly available.
Crawl Policy
- robots.txt
- Fully respected
- Crawl-Delay
- Respected (default: 0.5s between requests)
- Max rate
- 2 req/s per domain
- Purpose
- Search index only — not AI training
- AI training
- No
Opt Out
To block MeshKoreBot from crawling your site, add this to your robots.txt:
User-agent: MeshKoreBot Disallow: /
Or email to have a specific URL or domain removed from the directory.