Paul-HenryP/robotex

Add a Native Test Suite (Zero Dependencies) 1 day ago

enhancement help wanted

0

An automated robots.txt generator and active middleware blocker for web developers.

JavaScript

#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping

External Cache Adapters for Serverless/Edge Environments 1 day ago

enhancement help wanted

Paul-HenryP/robotex

0

An automated robots.txt generator and active middleware blocker for web developers.

JavaScript

#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping

Create a native Vite / Rollup Plugin export 1 day ago

enhancement help wanted

Paul-HenryP/robotex

0

An automated robots.txt generator and active middleware blocker for web developers.

JavaScript

#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping

Support Regex / Wildcard matching for custom bots 1 day ago

enhancement help wanted

Paul-HenryP/robotex

0

An automated robots.txt generator and active middleware blocker for web developers.

JavaScript

#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping

Add Middleware examples for Express.js and Nuxt to the README 1 day ago

documentation enhancement help wanted good first issue

Paul-HenryP/robotex

0

An automated robots.txt generator and active middleware blocker for web developers.

JavaScript

#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping

Add support for custom blocklist URLs 1 day ago

enhancement help wanted good first issue

Paul-HenryP/robotex

0

An automated robots.txt generator and active middleware blocker for web developers.

JavaScript

#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping

Allow multiple sitemaps in robotex.json 1 day ago

enhancement help wanted good first issue

Paul-HenryP/robotex

0

An automated robots.txt generator and active middleware blocker for web developers.

JavaScript

#ai-bots#bot-protection#cli-tool#middleware#nextjs#open-source#robots-txt#robots-txt-generator#robots-txt-tool#security#seo#web-scraping

Open Issues Need Help