Brokoli
Open-source data orchestration. One binary. Zero dependencies.
go install github.com/Tnsor-Labs/brokoli/broked@latest
broked serveFeatures
Visual Pipeline Editor -- Drag-and-drop DAG builder. Connect sources, transforms, and sinks without writing config files.
Python SDK -- Define pipelines as code with Pipeline() context manager and the >> operator. Version-controlled, testable.
Cron Scheduling -- Standard cron expressions with timezone support, catch-up runs, SLA deadlines, and cross-pipeline dependencies.
Data Quality -- Built-in assertions: not_null, unique, range, regex, freshness, type checks. Block or warn on failures.
Single Binary -- One Go binary. Embedded UI. SQLite by default. No Kubernetes, no Redis, no message broker required.
Full REST API -- Every action in the UI is available via API. JWT auth, API keys, WebSocket real-time events.
How it compares
| Feature | Brokoli | Airflow | Dagster | Prefect |
|---|---|---|---|---|
| Install time | 30 seconds | 15+ minutes | 5+ minutes | 5+ minutes |
| Dependencies | None | Postgres, Redis, Celery | Postgres | Postgres |
| Visual editor | Built-in | No (3rd-party) | Limited | No |
| Pipeline as code | Python SDK | Python DAGs | Python assets | Python flows |
| Scheduling | Built-in cron | Built-in | Built-in | Cloud/server |
| Binary size | ~27 MB | ~500 MB+ (Docker) | ~300 MB+ | ~200 MB+ |
| Real-time monitoring | WebSocket | Polling | Polling | Polling |
| Data quality | Built-in nodes | External (Great Expectations) | Built-in | External |
| Language | Go + Python SDK | Python | Python | Python |
Architecture
┌───────────────────────────────────────┐
│ broked binary │
│ ┌──────────┐ ┌──────────┐ ┌───────┐ │
│ │ REST API │ │Scheduler │ │Engine │ │
│ │ + WebSocket│ │ (cron) │ │(runner)│ │
│ └──────────┘ └──────────┘ └───────┘ │
│ ┌──────────────────────────────────┐ │
│ │ Embedded Svelte UI │ │
│ └──────────────────────────────────┘ │
│ ┌──────────────────────────────────┐ │
│ │ SQLite (default) / Postgres │ │
│ └──────────────────────────────────┘ │
└───────────────────────────────────────┘15 Node Types
Sources: source_file, source_api, source_db -- Transforms: transform, code, join, sql_generate -- Logic: quality_check, condition -- Sinks: sink_file, sink_db, sink_api -- Operations: migrate -- Integrations: dbt, notify