The Universal Data Orchestrator: The Heartbeat of Data Engineering
Discover why data orchestrators are essential in modern data engineering and how Kestra's unique dual interface paradigm combines powerful UI and code-first approaches through YAML to solve today's co...
In an open data stack, the heartbeat of your data platform isn't your warehouse or lake. Data is the foundation to extract the business value, but if you can't visualize or make sense of it, it won't help you. That's why I'd argue the key toolset is your orchestrator.
New blog post out π.
15.04.2025 11:46 β
π 8
π 2
π¬ 1
π 1
From 1,240 to 6,200+ daily jobs in 6 months.
99.5% success rate.
All event-driven. All Terraform. All with Kestra.
Here's how Sopht built a scalable, customer-isolated orchestration layer with Kestra: kestra.io/use-cases/st...
23.04.2025 14:50 β
π 2
π 2
π¬ 0
π 0
GitHub - kestra-io/plugin-graalvm
Contribute to kestra-io/plugin-graalvm development by creating an account on GitHub.
The new release of @kestra.io with a @graalvm.org plugin that I worked on.
I'm thrilled to have been able to use this fantastic project, and GraalVM brings essential features that we needed:
- Interoperability
- Performance
- Dependencies (Python only)
- Security
π§΅1/5
github.com/kestra-io/pl...
01.04.2025 13:46 β
π 9
π 3
π¬ 1
π 0
YouTube video by Kestra
Kestra 0.22 introduces support for Plugin Versioning, Read-Only Secrets Backends, LDAP and More!
β¨ Kestra 0.22 is here! β¨
βοΈ Plugin Versioning
π Read-Only external secrets
π€ LDAP Sync
π¦ Cross-namespace file sharing
π Run tasks after flows finish
πΎ Enhanced Queues taking up to 90% less database space
youtu.be/pLVpimXVJ8Y
01.04.2025 12:48 β
π 5
π 2
π¬ 1
π 0
Kestra Apps make automation accessibleβno code, APIs, or scripts needed. Upload files, request data, approve workflowsβall without engineering bottlenecks.
Developers stay in control. Teams get a simple interface. Everyone wins.
See how Apps work: kestra.io/blogs/use-ca...
28.02.2025 15:30 β
π 5
π 2
π¬ 0
π 0
YouTube video by Kestra
Automate and Orchestrate Python with Kestra
Running #Python scripts manually worksβuntil it doesnβt.
In our latest video, we show how to:
β
Schedule Python scripts (e.g., daily reports)
β
Trigger workflows with webhooks & real-time data
β
Automate processing when new files arrive
youtu.be/FIOIvNwtKM8
25.02.2025 16:01 β
π 4
π 2
π¬ 0
π 0
16,000 GitHub stars! βοΈ
A year ago, we were celebrating 5,000. Now, 20k is in sight.
Stars mean that Kestra is finding its place in open source. That what weβre building matters.
A big thank you to everyone whoβs supported us along the way! π
π« github.com/kestra-io/ke...
24.02.2025 14:50 β
π 9
π 2
π¬ 0
π 0
π₯πΆοΈπ₯
04.02.2025 19:35 β
π 1
π 0
π¬ 0
π 0
2025 Data Engineering & AI Trends
How Generative AI, new data regulations, and open table formats affect the data engineering landscape in 2025 and beyond
How Generative AI, new data regulations, and open table formats affect the data engineering landscape in 2025 and beyond. Discover mor ein our latest blog post!
kestra.io/blogs/2025-d...
25.01.2025 17:05 β
π 3
π 2
π¬ 0
π 0
Kestra is very intuitive technology. And guess what? It's built on top of #micronautfw! Learn more at micronaut.io/micronaut-su...
21.01.2025 16:52 β
π 12
π 4
π¬ 0
π 0
Embedded Databases and 2025 Trends: Developer's Perspective
An overview of embedded databases like DuckDB, chDB, SQLite, and Limbo for 2025βhighlighting performance, use cases, and key features.
Choosing the right embedded database? Whether itβs duckdb , chDB by ClickHouseDB , SQLite, or the rising Limbo by Turso, has a unique edge for ETL, real-time APIs, and large datasets. Hereβs the 2025 breakdown:
kestra.io/blogs/embedd...
18.01.2025 15:31 β
π 5
π 1
π¬ 0
π 0
Empower Business Users with Kestra Apps: Build Intuitive UIs on Top of Your Workflows
Endless possibilities with Kestra Apps
With Apps, you can make Kestra workflows accessible to everyone, regardless of their technical expertise.
Weβre excited to see how youβll use them to build self-service applications for your data products and business processes.
kestra.io/blogs/use-ca...
20.01.2025 16:14 β
π 4
π 3
π¬ 0
π 0
YouTube video by Kestra
Access Local Files inside of Kestra | How-to Guide
In Kestra, you can access files stored on your local machine inside of your Flows. This can be useful if you have a directory of files you want to process, or code you want to run without having to run them.
youtu.be/aWvUtbu8FAo
30.12.2024 16:02 β
π 4
π 1
π¬ 0
π 0
We are ending the year with an amazing news! Kestra just hit 15,000 stars on GitHub π₯
github.com/kestra-io/ke...
31.12.2024 15:08 β
π 4
π 2
π¬ 0
π 0
YouTube video by Andreas Kretz
Live Demo: Smart Workflow Orchestration - The Best I've Ever Seen!
π Missed the Livestream? Catch up on workflow orchestration!
β
UI-driven, declarative workflow automation
β
Business vs. orchestration logic
β
Integrations with Snowflake, Databricks & more
youtu.be/bVIQMRoebUs
02.01.2025 14:17 β
π 4
π 1
π¬ 0
π 0
β‘οΈ Kestra 0.20 is live! β‘οΈ
πhttps://kestra.io/blogs/release-0-20
β¬₯ Build custom UIs with Apps
β¬₯ Data isolation across teams
β¬₯ In-app announcements
β¬₯ Flow-level SLAs
β¬₯ Skip tasks with runIf
β¬₯ Enhanced flow triggers
β¬₯ Pause flows mid-run
β¬₯ Many new plugins
β¬₯ UI Bookmarks
03.12.2024 20:07 β
π 5
π 2
π¬ 0
π 0
π¨Deal Alert π¨
π Check it out here: producthunt.com/posts/kestra
Kestra, the best orchestration platform for ALL your workflows, is live on Product Huntβfor the unbeatable price of $0! π€©
π¬ Drop a comment and enjoy unlimited good vibes & lifetime open-source community support.
29.11.2024 11:12 β
π 6
π 2
π¬ 0
π 0
YouTube video by Kestra
Make Your Code Dynamic with Kestra in 60 seconds
π‘ Dynamic Workflows, Simplified
With Kestraβs Expressions, passing data at runtime is easy:
βοΈ Dynamically update URLs or parameters.
βοΈ Avoid hardcoding for flexible workflows.
βοΈ Adjust inputs and execute scripts efficiently.
youtu.be/X290__cVfGE
16.11.2024 14:51 β
π 5
π 1
π¬ 0
π 0
GitHub - kestra-io/kestra: :zap: Workflow Automation Platform. Orchestrate & Schedule code in any language, run anywhere, 500+ plugins. Alternative to Zapier, Rundeck, Camunda, Airflow...
:zap: Workflow Automation Platform. Orchestrate & Schedule code in any language, run anywhere, 500+ plugins. Alternative to Zapier, Rundeck, Camunda, Airflow... - kestra-io/kestra
Kestra.io is now on Bluesky π
Give us a follow and keep up with our latest news !
github.com/kestra-io/ke...
01.11.2024 23:19 β
π 9
π 2
π¬ 1
π 0