Kestra

🎉 Congrats to the Kestra team for the release of their new course on OpenClassrooms! 🎉 Well done to Benoit Pimpaud for your valuable work in making this course a reality. Shoutout to Emmanuel Darras & Jérémy Ollier for making this alive 🚀 🔗 Course Overview Are you looking to simplify complex workflows and automate repetitive tasks? Kestra can help you orchestrate your data processes with ease. In this course, you’ll learn how to create, trigger, and monitor data flows in real time. You’ll also see how Kestra handles parallel tasks, integrates with external tools, and helps you detect and resolve issues efficiently. By the end of the course, you'll be able to: - Understand the fundamentals of Kestra - Use Kestra in advanced projects If you’re interested in improving your data orchestration, check out the course: https://lnkd.in/eEcUFQtX. 💡 Looking Ahead to 2025 at DataGalaxy 🧑🚀 At DataGalaxy, we’re planning to use DuckDB and Kestra for orchestration to further improve our data workflows. I’ll definitely be asking my team to follow your classes Benoit Pimpaud ! Déborah Rouiller, AYOUB HAMAOUI, Noah Michel 🌟

This is the simplest and clearest Workflow Orchestration tool I ever saw! 👇 Let me tell you: my recent livestream session featuring a live demo of Kestra's orchestration platform was such an eye-opener for me. Watch the recording here: https://bit.ly/400jUjI I sat down with Kestra's DevRel Will Russell to unpack how to simplify workflows and scale pipelines without all the headaches. Here's what stood out to me: ✅ Super easy installation ✅ Simple pipeline creation through YAML files or visual topology ✅ Implementation of tools through over 600+ easy to use plugins ✅ Integrated documentation on how to use plugins In our session we were diving into: ➡️ The difference between business logic and orchestration logic (and why it matters!) ➡️ How to easily build, run, and monitor workflows using both code-first and low-code approaches ➡️ Why visualizing your pipelines with topology views and Gantt charts can make debugging a breeze ➡️ Best practices for running workflows locally or in the cloud (including seamless Git and container integration) ➡️ What’s next for workflow orchestration: low-code tools, cloud-based deployment, and more It’s packed with practical insights and tips you can use right away. Watch it and let me know: what’s one workflow challenge you’re ready to tackle in 2025? I’d love to hear your thoughts on YouTube! #sponsored #dataengineer #dataengineering #workfloworchestration #orchestrationplatform #kestra 

Another great tutorial from Abhishek Veeramalla on how to create internal devs platform with Kestra! 👉 https://lnkd.in/eVicbKZ2

Big data processing and ML workflows with Databricks often hit familiar pain points: 💸 Cluster costs spiraling from idle time or misconfigurations. 🔗 Limited workflows when external systems like APIs or cloud storage. 🔍 Debugging blind spots that leave you chasing logs. Many developers use Kestra to overcome these gaps—automating cluster management, orchestrating ETL pipelines across systems, and simplifying file management. The result? ✅ Reduced costs with precise cluster lifecycles. ✅ Smarter workflows connecting Databricks with APIs, cloud storage, and more. ✅ Full visibility into your data operations. Learn more here: https://lnkd.in/dhjyGKYY

Emmanuel Darras of Kestra shares #predictions for 2025. By 2025, no-code tools are set to embrace code-first capabilities, creating a bridge between simplicity and scalability. This integration will transform how both technical and non-technical users approach automation and development. https://lnkd.in/g5Wc7v2y #AI #automation #development

🚀 Watch me create a #DevOps Schedule API Health Check + #Slack Alert workflow in just 5 seconds! What you'll see in this quick demo: ✨ Setting up automated server health monitoring ✨ Configuring daily checks (9 AM schedule) ✨ Integrating instant Slack notifications ✨ Creating a microservices-driven workflow Star Kestra: https://bit.ly/3ZMA3sJ 🔍 Key Features: • Automated health status verification • Smart alert system • Daily scheduling • Zero-complexity setup Perfect for: 👉 DevOps Engineers 👉 System Administrators 👉 IT Managers 👉 Tech Leads Watch how simple it can be with the Kestra Open Source tool: https://bit.ly/3ZMA3sJ Let's connect! Share your thoughts in the comments below 💭 #DevOps #Automation #TechTutorial #Microservices #ITOps #TechInnovation #CloudComputing #DevOpsAutomation #SlackIntegration #TechCommunity Kestra

🎉 Congrats to the Kestra team for the release of their new course on OpenClassrooms! 🎉 Well done to Benoit Pimpaud for your valuable work in making this course a reality. Shoutout to Emmanuel Darras & Jérémy Ollier for making this alive 🚀 🔗 Course Overview Are you looking to simplify complex workflows and automate repetitive tasks? Kestra can help you orchestrate your data processes with ease. In this course, you’ll learn how to create, trigger, and monitor data flows in real time. You’ll also see how Kestra handles parallel tasks, integrates with external tools, and helps you detect and resolve issues efficiently. By the end of the course, you'll be able to: - Understand the fundamentals of Kestra - Use Kestra in advanced projects If you’re interested in improving your data orchestration, check out the course: https://lnkd.in/eEcUFQtX. 💡 Looking Ahead to 2025 at DataGalaxy 🧑🚀 At DataGalaxy, we’re planning to use DuckDB and Kestra for orchestration to further improve our data workflows. I’ll definitely be asking my team to follow your classes Benoit Pimpaud ! Déborah Rouiller, AYOUB HAMAOUI, Noah Michel 🌟

Snowpipe remains a valuable tool for lightweight ingestion scenarios, but its scope is limited. For data teams managing complex workflows, Kestra provides the orchestration capabilities to scale, optimize, and simplify operations. With Kestra, you move beyond basic ingestion to build dynamic, event-driven workflows that integrate with Snowflake. Whether it’s handling complex transformations, responding to real-time events, or managing downstream processes, Kestra ensures your data pipelines are both powerful and future-proof. Learn more: https://lnkd.in/extwQjpy

Live Demo: Smart Workflow Orchestration Workflow orchestration has always been a bit of a headache for me. Setting up pipelines, managing dependencies, and scaling reliably... It’s no small task! That’s why I’m super excited to explore Kestra in next week's livestream. It is an open-source platform that promises to make orchestrating workflows smarter, not harder. ⏰ December 17th 10am EST / 7am PT In the livestream, Kestra's DevRel, Will Russell, will show us hands-on: ✅ How Kestra simplifies workflow automation with its UI and declarative approach ✅ The difference between business logic and orchestration logic (I’ve been curious about this!) and much more! Bring your questions and let’s have a great time exploring this together! P.S.: Also check out Kestra’s GitHub repo to dive into the topic in advance: https://bit.ly/4ixEvTO #sponsored #dataengineer #dataengineering #workfloworchestration #cloud #lowcode #kestra

🌿 The Strangler Fig Pattern for Orchestration 🌿 Migration doesn’t have to be an all-or-nothing move. The Strangler Fig Pattern offers a smarter approach—a gradual transition that minimizes risk while delivering value every step of the way. Instead of uprooting everything at once, you let the new system take over workflows incrementally. With Kestra, this means gradually bringing workflows under a centralized control plane, gaining better visibility and scalability along the way. As more workflows move into Kestra, the old system naturally fades into the background—until Kestra handles everything. Why take this approach? ✔️ Minimize disruptions during the transition. ✔️ Avoid a risky, full-systems migration. ✔️ Centralize visibility and enhance scalability, even while transitioning. learn more: https://lnkd.in/emYqTTJE