Kestrel
- Client
- Open source
- Year
- 2024
- Discipline
- Developer Tooling
- Role
- Author, maintainer
Kestrel is a command-line tool for running data pipelines locally before they ever touch a cluster. You describe a pipeline once; Kestrel gives you the same run, the same failures and the same logs on a laptop.
It began as a script I kept copying between teams. It is now a maintained open-source project with six thousand stars, forty contributors and a small plugin API.
The interesting problem was never the runner — it was making failures legible. Every error carries the node, the input record and the exact line that produced it.