Building out Dagster, the data orchestration platform built for productivity. Join the team that is hard at work, setting the standard for developer experience in data engineering. Dagster Github: https://github.com/dagster-io/dagster
External link for Dagster Labs
San Francisco, California, US
Minneapolis, Minnesota, US
New York City, New York, US
Los Angeles, California, US
Learn how to leverage the power of Dagster and Snowflake's Snowpark Container Services (SPCS) in this compelling post by Phani Raj!
Are you running Dagster for orchestrating your data or ML pipelines and want to know how to run Dagster in Snowflake, then this blog is for you. https://lnkd.in/gT9nb6qQ
Dagster Labs reposted this
Welcome to 30 days of orchestration! Join me this holiday season, solve some fun coding challenges, and learn about orchestration (and Dagster) along the way. https://lnkd.in/gWMTWipR
Dagster Labs reposted this
Tomorrow morning at 9 AM PST I'll be speaking on a panel for Dagster Labs' Data Platform Week! We'll cover the broad strokes on how we see the data industry evolving, as well as well as future roadmaps for our products based on the trends we're seeing from customers. Super excited to share the virtual stage with Jake Hannan from Sigma Computing and Eric Veleker from Atlan. Sign up link in the comments!
"For guys like us, every week is Data Platform Week" Check out the latest episode of What's New in Data with our developer Advocate, Alex Noonan. In it he discusses his non-traditional background, the data social media landscape, and the latest features in Dagster!
From Marine Aircraft to Data Engineering: Navigating Social Media Shifts and AI Innovation with Alexander Noonan 💡 In the latest episode of "What's New in Data," host John Kutay explores the evolving dynamics of knowledge sharing within the data community, particularly the influence of social media. He is joined by Alexander Noonan a Developer Advocate at Dagster Labs, who shares his journey into the field of data engineering. Give this episode a listen to discover: 🌟 How Alex Noonan transitioned from the Marines to a data engineer, bridging unique career paths 🐦 The evolution of data Twitter and a migration towards up-and-coming platforms 🔑 Tips for leveraging LinkedIn, Reddit, and Hacker News for professional networking in data 🤖 The role of AI in streamlining data processes 🔄 How Dagster integrates BI tools to optimize the data engineering experience 🔗 Tune in now: Spotify: https://lnkd.in/g59YuJeZ Apple: https://lnkd.in/gzT4TUQ8 #whatsnewindata
Dagster Labs reposted this
Data Engineer using Dagster Labs? My colleague Hazem will demo how to execute several Soda Checks Language (SodaCL) checks at multiple points within your Dagster pipeline. #dataengineering #dagster #dataquality #soda
👋 Calling all Data Engineers: learn how to integrate data quality checks into both development and production pipelines using Dagster in this technical showcase. 🖥 Our Customer Engineer Hazem El-Dabaa will demonstrate how to execute several Soda Checks Language (SodaCL) checks at multiple points within your Dagster pipeline. ➡ Key takeaways include how to: * implement SodaCL checks to ensure data quality at various stages of your pipeline * automate and streamline your ETL process with Dagster and dbt * deliver trusted data for downstream analytics, minimizing data quality issues in production Join on LinkedIn Live or register here for Zoom: https://lnkd.in/eyYQc7G5
If you haven't been able to make the Data Platform Week live sessions, don't worry! They are available on our YouTube, link in the comments!
In case you missed the Data Platform week live sessions, we have added the recordings to our YouTube channel so you can watch them at your leisure. Link in the comments!
Dagster Labs reposted this
👀 🤯 Interested to see what we’ve been cooking up at Dagster? Join us in in 25 minutes to learn more! https://lnkd.in/eSZJP5XA
Data Engineering doesn't have to be a drag Join us at AWS re:Invent to discover how Dagster is revolutionizing data engineering. Stop wrestling with complex pipelines and start building robust, scalable data platforms. Visit our booth to see how leading companies manage data chaos and accelerate their data initiatives with Dagster. #dataorchestration #datapipelines #reInvent
🔄 From Legacy to Cloud: How Servco Transformed its Data Operations Excited to share how Servco Pacific Inc., revolutionized its data infrastructure. Led by Tausif Islam and Samuel I., the team tackled a common enterprise challenge: moving from siloed, on-premise systems to a modern cloud-native platform. Key Transformations: - Migrated from on-premise SQL to Google BigQuery - Implemented Dagster for orchestration and documentation - Built semantic models with clear data lineage - Enabled self-service analytics across departments "We're not just providing data anymore; we're also providing context," - Tausif Islam, Director of Data Visualization, Analytics and Automation. Read the full case study today! Link in comments #DataEngineering #DigitalTransformation #CloudComputing #Analytics #ModernDataStack