At work, I’ve just released another open-source project that I’m really excited about: Kusto Slice Runner.
If you’re a developer or data engineer who uses a lot of Kusto (Azure Data Explorer), this is probably worth exploring a bit. It’s a developer-desktop job orchestration system for time-windowed queries. This is useful for doing ad-hoc analysis of enormous datasets, setting up prototypes of new pipelines, or even for developing changes to existing pipelines. It comes with existing skills that help your agent easily make new jobs and manage existing ones. All the state is stored locally in sqlite, and then served to a local web page.
There are tons of features packed in while still keeping the basic interactions simple and effective. I’ve been working on this for the past few months, and it has been an indispensable tool for me in my role as an individual contributor tasked with exploring new ideas for the org to pursue. I feel like I have a whole team working for me on all my various projects, not just developing them, but monitoring and maintaining them over time.