Open Issues Need Help
View All on GitHub Add sitemap.xml support 1 day ago
enhancement good first issue
🕷️ The web crawler you can watch crawl. Neon spiders swarm every page while a live graph maps the site, then you get clean Markdown + JSON. SSRF-safe and robots.txt-polite.
Python
#canvas#cli#fastapi#markdown#python#robots-txt#scraper#ssrf#termux#visualization#web-crawler