AjnasNB/cockroach-crawler

design: optional durable crawl jobs and signed webhooks 12 days ago

enhancement help wanted security

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Add resumable local crawl checkpoints bound to policy fingerprints 12 days ago

enhancement help wanted testing security

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

test: reproduce the 0.4.2 packed install and native MCP boundary 12 days ago

documentation help wanted good first issue testing

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Generate shell completions and man pages for all public CLIs 12 days ago

documentation enhancement help wanted good first issue CLI

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Add a bounded RSS/Atom document parser and source adapter 12 days ago

enhancement help wanted testing providers

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

feat: add an opt-in bounded document and PDF parser 13 days ago

enhancement help wanted security

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

feat: add bounded adaptive crawling and policy-aware cache 13 days ago

enhancement help wanted security

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Launch kit: add alpha.2 demo and remove stale Node 20 metadata 16 days ago

documentation help wanted good first issue

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Release validation: test v0.3.0-alpha.2 providers and security boundaries 16 days ago

help wanted testing providers security

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Validate successful GitHub payload shapes before normalization 17 days ago

help wanted good first issue testing provider:github

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Add an offline MCP tool adapter for bounded crawl dispatch 18 days ago

enhancement help wanted testing security

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Build a reusable SourceProvider conformance harness 18 days ago

help wanted testing providers

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Expand offline Reddit OAuth contract fixtures 18 days ago

help wanted testing provider:reddit

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Expand offline X API v2 contract fixtures 18 days ago

help wanted testing provider:x

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Expand offline YouTube API and oEmbed contract fixtures 18 days ago

help wanted testing provider:youtube

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Expand offline GitHub adapter error-contract fixtures 18 days ago

help wanted testing provider:github

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Make source status output accessible without color 18 days ago

good first issue accessibility CLI

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Add JSON Schema for normalized source records 18 days ago

documentation good first issue types

AjnasNB/cockroach-crawler

1

Bounded public-web crawling and read-only source adapters for Node.js agent workflows.

JavaScript

#agent-tools#cloudflare-workers#crawler#nodejs#open-source#robots-txt#ssrf-protection#typescript#web-crawler#web-scraping

Open Issues Need Help