Open Issues Need Help
View All on GitHub Filter allowBots from community blocklist to prevent duplicate entries about 1 month ago
bug help wanted good first issue
An automated robots.txt generator and active middleware blocker for web developers.
JavaScript
#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping
Add a Native Test Suite (Zero Dependencies) about 2 months ago
enhancement help wanted
An automated robots.txt generator and active middleware blocker for web developers.
JavaScript
#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping
External Cache Adapters for Serverless/Edge Environments about 2 months ago
enhancement help wanted
An automated robots.txt generator and active middleware blocker for web developers.
JavaScript
#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping
Create a native Vite / Rollup Plugin export about 2 months ago
enhancement help wanted
An automated robots.txt generator and active middleware blocker for web developers.
JavaScript
#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping
Support Regex / Wildcard matching for custom bots about 2 months ago
enhancement help wanted
An automated robots.txt generator and active middleware blocker for web developers.
JavaScript
#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping
Add Middleware examples for Express.js and Nuxt to the README about 2 months ago
documentation enhancement help wanted good first issue
An automated robots.txt generator and active middleware blocker for web developers.
JavaScript
#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping
Add support for custom blocklist URLs about 2 months ago
enhancement help wanted good first issue
An automated robots.txt generator and active middleware blocker for web developers.
JavaScript
#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping
Allow multiple sitemaps in robotex.json about 2 months ago
enhancement help wanted good first issue
An automated robots.txt generator and active middleware blocker for web developers.
JavaScript
#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping