Paul Wisneskey

At our #Coalesce2024 keynote this morning, Tristan Handy shared his vision for the future of the analytics workflow: One dbt. One dbt is an ethos that influences all aspects of how we operate at dbt Labs. It represents our commitment to an integrated, governed, and scalable approach to data analytics. We are building towards a future where everyone—from data engineers to analysts to business decision-makers—has a common unifying framework for solving analytics problems. This framework should allow all of these humans to collaborate on any data platform, on any cloud. Their work should be accelerated by AI. And they should be able to work in the tools that make the most sense for them. Here are the latest platform features, which exemplify the One dbt ethos: • Cross-platform dbt Mesh: Practitioners will be able to reference and re-use data assets from not only different projects, but also different data platforms, breaking down silos and fostering collaboration across an organization’s full data estate. • Iceberg table support: This allows users to leverage the benefits of Iceberg's table format, including improved query performance and schema evolution. • Visual editing experience: We are adding an intuitive, visual drag-and-drop interface (currently in beta) to our suite of data development environments. • dbt Copilot: dbt Cloud’s embedded AI engine with various user experiences across the dbt workflow designed to help users accelerate and automate analytics (currently in beta). • Advanced CI: Each CI job will include a breakdown of the columns and rows that are being added, modified, or removed in your underlying data platform as a result of executing your dbt job.  • Auto-exposures with Tableau: Now in Preview, the dbt DAG can be automatically populated with downstream exposures in Tableau (and Power BI to follow). • Data health tiles: With dbt Cloud, you can now embed health signals like data quality and freshness within any dashboard, giving your downstream stakeholders at-a-glance confirmation of whether they can trust the data they’re about to use. • New integrations: dbt Cloud now integrates with Amazon Web Services (AWS) Athena (GA) and Teradata (Preview), enabling more organizations and teams to collaborate on data workflow. • dbt Core v1.9: dbt remains committed to advancing our open source offering for data practitioners, and starting in Core 1.9, we have two big improvements, available now in beta. Read our blog (link in comments) to learn more about the new features and how we empower data teams to work seamlessly across data ecosystems. Which new features are you most excited about?

425

7 Comments

Frances Perry, Engineering Manager at MotherDuck, joins Data @Scale on May 22 to discuss how modern data processing systems were designed at a time when hardware looked very different than it does today. And as the early hype around big data settled, it became clear that most analytics only use a subset of the data that is available. Register today to hear her talk, Taking Flight With Interactive Analytics, at https://lnkd.in/gvkyDK8H. #DataAtScale

14

New blog post by Alex Monahan: Benchmarking Ourselves over Time at DuckDB The DuckDB team's philosophy is to ensure correctness first, then iterate and optimize to improve performance. This blog explores how this happened over the last three years when DuckDB became approximately 3-25x faster and 10x more scalable. Read more at https://lnkd.in/dnQ7Nya8

197

16 Comments

Last Friday we were joined by Eric Hansander from Twirl who talked to us about their platform for data teams who are looking to ship value, not tooling. The title of the talk was: "What makes a great data platform?". Check out the replay here: https://lnkd.in/dpGcsQtz If you don't already receive DSF invites, look in the comments for how to join that talk with Opper AI on Friday 17th May ! #DataScienceFriday #CodonConsulting #TwirlData

19

1 Comment

In our latest blog, "The Kessel Run Conundrum: Navigating Through Data Quality Metrics," Arturo Morales, PhD, uses the iconic Star Wars reference of the Kessel Run to illustrate how focusing on the wrong data quality metrics can lead to misleading conclusions. Art explains the difference between vanity metrics and actionable metrics, emphasizing the importance of context in assessing data quality. Are you interested in improving your data quality metrics? Read more at: https://lnkd.in/d4WMfFKq

21

1 Comment

Data hoarders are a real thing, and for many firms, they cause roadblocks to critical service. In this webinar clip, hear the co-founder and CEO of Passthrough, Tim Flannery, describe this common concern and the solution. For more insights into workflow automation, watch the full webinar here: https://lnkd.in/gPGPBCSG

10

Our ComboSync and API data integration solutions have been a hot topic after Samantha Johnson, P.E.'s, and Elk Range Royalties' success story (https://lnkd.in/e5P6N337). To meet the diverse needs of our clients, we offer three solutions for integrating data with ComboCurve: ComboSync, REST API Integration, and Manual Upload/Export. Each solution is designed to provide unique benefits. Regardless of your company’s size or technical capability, there is an option that meets your needs. Read more on our data integration options here: https://lnkd.in/eBGgCW_N #combocurve #dataintegration #solution #oilandgas #engineering

38

🚨 Reminder, Class 2 of RMU is today at 2:00 PM EST! We’ll be unlocking the secrets of managing the lifecycle of records—from pinpointing location to harnessing the power of metadata and assessing record value. This session is packed with insights you won’t want to miss! See you there! #RecordsManagement #RMU #DataLifecycle #MetadataMatters #InformationGovernance

17

3 Comments

Who doesn't love savings? 🤑 Learn how Adam Bayrami and his team at NerdWallet halved their Snowflake costs at Airflow Summit! Join Adam and fellow data enthusiasts in San Francisco on September 10th-12th by registering below! #airflowsummit2024 #dataconference #costoptimization

24

Dillon Tay introduces our next #DigitalDiscovery featured article: "Discover how our composite machine learning model, blending graph and decision tree architectures, achieves natural product classification with unprecedented accuracy. This approach also uncovers hidden structure-taxonomy relationships that could streamline bioprospecting efforts." Read the open access paper by Tay and Ang here: https://lnkd.in/erY6F_fh

38

2 Comments

🚀 𝐀𝐧𝐚𝐥𝐲𝐭𝐢𝐜𝐬 𝐇𝐞𝐫𝐨𝐞𝐬 𝐭𝐨 𝐭𝐡𝐞 𝐑𝐞𝐬𝐜𝐮𝐞! 🦸 Featuring Ryan Brown, Sr. Data Engineer Architect at Trace3. 🙎‍♂️ Ryan’s an experienced data & analytics engineering expert, having worn multiple hats—analyst, engineer, consultant, and now architect. With over five years of experience building optimized ETL pipelines and data infrastructures, he’s seen it all. And in our latest episode, he’s spilling the secrets! 🎤💡 In Episode 2, we chopped it up with Ryan about the big stuff shaking up the analytics world. Here’s a quick teaser of what’s coming your way: 💠 The transition from 𝐅𝐚𝐛𝐫𝐢𝐜 𝐭𝐨 𝐃𝐚𝐭𝐚𝐛𝐫𝐢𝐜𝐤𝐬—and why it’s a game-changer 💠 𝐂𝐨𝐧𝐧𝐞𝐜𝐭𝐢𝐧𝐠 𝐭𝐡𝐞 𝐃𝐨𝐭𝐬 to ROI—where data meets $$$ 💠 Turning 𝐃𝐚𝐭𝐚 𝐑𝐞𝐜𝐨𝐫𝐝𝐬 𝐢𝐧𝐭𝐨 𝐅𝐢𝐧𝐚𝐧𝐜𝐢𝐚𝐥 𝐂𝐥𝐚𝐫𝐢𝐭𝐲—making sense of it all 💠 Why 𝐈𝐧𝐧𝐨𝐯𝐚𝐭𝐢𝐨𝐧 𝐄𝐪𝐮𝐚𝐥𝐬 𝐄𝐟𝐟𝐢𝐜𝐢𝐞𝐧𝐜𝐲—and how to stay ahead 💠 The 𝐃𝐨𝐮𝐛𝐥𝐞-𝐄𝐝𝐠𝐞𝐝 𝐒𝐰𝐨𝐫𝐝 𝐨𝐟 𝐆𝐨𝐯𝐞𝐫𝐧𝐚𝐧𝐜𝐞—balancing control with speed 💠 Why 𝐌𝐨𝐝𝐮𝐥𝐚𝐫𝐢𝐭𝐲 & 𝐓𝐞𝐬𝐭𝐢𝐧𝐠 are key to a rock-solid data strategy Sound like your kind of conversation? Want to catch all of Ryan’s insights? Hit that 𝐒𝐮𝐛𝐬𝐜𝐫𝐢𝐛𝐞 link and get the episode sent straight to your inbox as soon as it drops! 🔔📬 𝐒𝐮𝐛𝐬𝐜𝐫𝐢𝐛𝐞: https://lnkd.in/dywmwe7T This one’s packed with real-world takeaways and industry trends that’ll have your team talking. Don’t miss out!

11

2 Comments

📢Validation Cloud now supports Stellar Horizon archive nodes! Stellar Development Foundation VP of Product Tomer Weller shares why Validation Cloud's support for Horizon will improve the developer experience and enhance Stellar's auditing and compliance features. Validation Cloud's archive nodes maintain a complete history of the Stellar network, allowing developers to query historical ledger data, transaction details, and account states. 📔Learn more: https://lnkd.in/esdTqwXg #Stellar #Horizon #DeFi #dApps

10

Check out this InsideAnalysis podcast with our CEO, Justin Borgman! Eric Kavanagh and Justin talked about analytic architecture, the #Icehouse, and how Starburst gives data teams the freedom to be curious. Listen to the whole episode here: https://okt.to/TJ8bMo #analyticarchitecture #bigdataanalytics #apacheiceberg #trinodb

15

Helping Data Teams Quickly Create and Disseminate Organizational Knowledge "Data Cloud Now" anchor Ryan C. Green chats with Tristan Handy, Founder and CEO of dbt Labs, about some of the innovations unveiled at the recent dbt Labs Cloud Launch Showcase and their significance to dbt Labs's mission to change how data practitioners work together in order to more quickly create and disseminate organizational knowledge. #SnowflakeSummit

15

💵 Funding News: 🗓️ News Month: October, 2024 🚀 Matia Raises $10.5M to Revolutionize Data Operations Miami-based Matia is making waves in data management with a platform that streamlines ingestion, reverse ETL, observability, and catalog capabilities. 🌐 Key Highlights: 🔸Funding Secured: $10.5M led by Leaders Fund and Secret Chord Ventures, with support from Cerca Partners and Caffeinated Capital. 🔸Growth Focus: Expanding engineering and product teams, enhancing platform capabilities, and driving go-to-market strategies. About Matia: Founded by brothers Benjamin Segal and Geva Segal, Matia simplifies data management by: 🔹Unifying tools for seamless data ingestion and reverse ETL. 🔹Enhancing observability and creating a robust data catalog. 🔹Fostering collaboration for smarter, faster decisions without tool overload. Trusted by Innovators: Early adopters like Ramp, HoneyBook, and Obligo rely on Matia to power their data and AI strategies. The future of streamlined, collaborative data operations is here. 💡 📢 Stay tuned to Future Techly for the latest updates on this groundbreaking initiative and the latest in tech and business! 💥 Source: FinSMEs ♻️ Repost if you think this insight is worth sharing!

2

Justin Francis, O3's Director of Data Integrations, will be explaining how O3 is the ultimate data consumer no matter what type or how messy it is. He'll be covering the following points:  Why O3 doesn't require a model (non-graphical) Why O3 doesn't require perfect graphical data to do graphical Why O3 doesn't require external model conditioning Why O3 has the market leading real time dynamic model parsing How O3 supports PCF, IDF IFC and all model file types. Register here: https://bit.ly/4bYnfmt

17

1 Comment