Tnsor-Labs/brokoli

Add native projection, expression, and aggregation operators for common transforms 2 days ago

enhancement help wanted priority/next area/backend

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Make dataset schemas first-class across joins and field expressions 2 days ago

enhancement help wanted priority/next area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Add reusable, language-neutral execution profiles for API sources 3 days ago

enhancement help wanted priority/next area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Tracking: connector coverage, what the catalogue advertises and what actually works 5 days ago

enhancement help wanted priority/next area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Connector: Azure Blob Storage for file nodes 5 days ago

enhancement help wanted area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Connector: Google Cloud Storage for file nodes 5 days ago

enhancement help wanted area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Connector: Google BigQuery, design first 5 days ago

enhancement help wanted question area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Connector: Databricks SQL 5 days ago

enhancement help wanted area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Connector: Oracle, through the pure-Go go-ora driver 5 days ago

enhancement help wanted area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Connector: Snowflake 5 days ago

enhancement help wanted area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Connector: SQL Server 5 days ago

enhancement help wanted milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Connection test reports success for database types that have no driver in this build 5 days ago

bug good first issue help wanted milestone-ready area/backend area/ui

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Plugin upgrade semantics: decide in-place swap vs versioned side-by-side 5 days ago

enhancement help wanted area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Finish ADR-022's structural fixes: close the netguard coverage gap, then move org scoping into the data layer 5 days ago

help wanted priority/now milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Show the server version on the login screen and before first-time setup 5 days ago

enhancement good first issue milestone-ready area/backend area/ui

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Remote file transport: let source_file and sink_file read and write over a connection (SFTP first, then S3) 5 days ago

enhancement help wanted priority/next

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

SFTP and S3 connections can be created, tested and advertised, but nothing can use them 5 days ago

bug documentation good first issue help wanted milestone-ready

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

preflight: govulncheck cannot distinguish "no vulnerabilities" from "could not reach the network" 5 days ago

bug good first issue help wanted milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

A degradation path must announce itself: audit the silent fallbacks 5 days ago

bug help wanted milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Database nodes accept an SFTP, S3 or HTTP connection and hand its URI to the database driver 5 days ago

bug good first issue help wanted milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

GET /api/pipelines/summary still counts each pipeline's newest 200 runs 5 days ago

bug good first issue help wanted milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

NewSQLiteStore(":memory:") gives each pooled connection its own empty database 5 days ago

bug help wanted milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Remove stale references to Svelte UI files in Go comments 5 days ago

documentation good first issue milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Add a Playwright e2e job for the React UI 5 days ago

enhancement help wanted milestone-ready area/ui

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

The webhook endpoint tells an unauthenticated caller whether a pipeline exists and whether it has a webhook 12 days ago

bug help wanted milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

The Security workflow never runs on pushes to main, so a commit that lands without a PR is never scanned 12 days ago

bug help wanted priority/next milestone-ready

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Webhook pipeline triggers never read the request body -- params can't be passed through 12 days ago

bug good first issue help wanted milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Node preview truncates to 50 rows with no indication, so a sample reads as the whole dataset 12 days ago

bug good first issue help wanted milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

requirePerm's OSS fallback is allow-by-default: an unrecognised role passes every gate 13 days ago

bug help wanted milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Arrow never engages on a dataset with an integer column, which is nearly all of them 13 days ago

enhancement help wanted milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Document the Node.js runtime requirement and add a TypeScript code-node example 15 days ago

documentation good first issue help wanted milestone-ready

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Rename the Arrow-named NDJSON helpers in engine/arrow_transfer.go -- they are not Arrow 15 days ago

good first issue help wanted milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Plugin invocation timeout: DeadlineExceeded can't say which deadline fired 15 days ago

good first issue help wanted milestone-ready

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Operations runbook and alert catalog for the engine's metrics 15 days ago

good first issue help wanted milestone-ready

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Ship webfonts with the binary instead of fetching them from Google at page load 15 days ago

bug good first issue help wanted milestone-ready area/ui

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Track ADR-036: JVM task bundles and the brokoli-jvm SDK 15 days ago

help wanted area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Server-side upsert-by-pipeline_id for SDK deploy 15 days ago

help wanted area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Prove cross-worker crash recovery for real, then wire paginated dispatch into it 15 days ago

help wanted priority/now milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Polyglot connector protocol: work-unit planning, structured progress, and cancellation 15 days ago

help wanted priority/now milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Add a minimal S3-compatible artifact.Store backend about 1 month ago

good first issue priority/now milestone-ready area/backend

Tnsor-Labs/brokoli

2

Brokoli — self-hosted data pipeline orchestration

Go

#data-engineering#data-ops#data-pipeline#data-quality#etl#go#golang#open-source#orchestration#pipeline#self-hosted#single-binary#sqlite#visual-editor#workflow

Open Issues Need Help