brainfish-ai

brainfish-ai/webcrawl-anything

Give your AI agent the whole web. Free, local, no API key. Search, scrape, map, crawl and monitor any site, PDF, YouTube video or CVE from Claude Code, Cursor, Codex or the CLI.

0 stars 2 forks 0 watchers TypeScript MIT License
ai-agents claude-code codex crawler cursor firecrawl-alternative llm markdown mcp mcp-server model-context-protocol pdf-parser rag search-engine typescript web-crawler web-scraper web-scraping
View on GitHub Website
5 Open Issues Need Help Last updated: Nov 3, 2026

Open Issues Need Help

View All on GitHub
Local mode prints raw PDF bytes for arXiv /pdf/ URLs 1 day ago
bug good first issue
brainfish-ai/webcrawl-anything
0

Give your AI agent the whole web. Free, local, no API key. Search, scrape, map, crawl and monitor any site, PDF, YouTube video or CVE from Claude Code, Cursor, Codex or the CLI.

TypeScript
#ai-agents#claude-code#codex#crawler#cursor#firecrawl-alternative#llm#markdown#mcp#mcp-server#model-context-protocol#pdf-parser#rag#search-engine#typescript#web-crawler#web-scraper#web-scraping
`map --filter` returns no URLs in local mode 1 day ago
bug good first issue
brainfish-ai/webcrawl-anything
0

Give your AI agent the whole web. Free, local, no API key. Search, scrape, map, crawl and monitor any site, PDF, YouTube video or CVE from Claude Code, Cursor, Codex or the CLI.

TypeScript
#ai-agents#claude-code#codex#crawler#cursor#firecrawl-alternative#llm#markdown#mcp#mcp-server#model-context-protocol#pdf-parser#rag#search-engine#typescript#web-crawler#web-scraper#web-scraping
Target plugin: npm package page (registry metadata + README) 1 day ago
good first issue target-plugin
brainfish-ai/webcrawl-anything
0

Give your AI agent the whole web. Free, local, no API key. Search, scrape, map, crawl and monitor any site, PDF, YouTube video or CVE from Claude Code, Cursor, Codex or the CLI.

TypeScript
#ai-agents#claude-code#codex#crawler#cursor#firecrawl-alternative#llm#markdown#mcp#mcp-server#model-context-protocol#pdf-parser#rag#search-engine#typescript#web-crawler#web-scraper#web-scraping
Add --no-cache to `webcrawl crawl` 1 day ago
enhancement good first issue
brainfish-ai/webcrawl-anything
0

Give your AI agent the whole web. Free, local, no API key. Search, scrape, map, crawl and monitor any site, PDF, YouTube video or CVE from Claude Code, Cursor, Codex or the CLI.

TypeScript
#ai-agents#claude-code#codex#crawler#cursor#firecrawl-alternative#llm#markdown#mcp#mcp-server#model-context-protocol#pdf-parser#rag#search-engine#typescript#web-crawler#web-scraper#web-scraping
Local search returns 'No results.' with exit 0 when keyless engines throttle 1 day ago
bug help wanted
brainfish-ai/webcrawl-anything
0

Give your AI agent the whole web. Free, local, no API key. Search, scrape, map, crawl and monitor any site, PDF, YouTube video or CVE from Claude Code, Cursor, Codex or the CLI.

TypeScript
#ai-agents#claude-code#codex#crawler#cursor#firecrawl-alternative#llm#markdown#mcp#mcp-server#model-context-protocol#pdf-parser#rag#search-engine#typescript#web-crawler#web-scraper#web-scraping