Andy McCann

In case you missed it 👀 Our very own Principal Data Engineer and Databricks Solution Architect Champion Dylan Ford created a guide into the world of DataOps, from foundational concepts to implementing best practices. In it, he shows you how to: ✅ Optimize data workflows ✅ Enhance cross-team collaboration ✅ Ensure the quality of your data assets 👉 Dive into Dylan's expert insights and embark on your DataOps journey in his blog post: https://lnkd.in/gGbHTFX6

40

A great read in iTnews today highlighting how Seven West Media leveraged Databricks to forecast audience view patterns on both a seven-day and 28-day horizon. The company is now scaling its use of Databricks to support additional analytics use cases. Andrew Brain, Audience Intelligence and Growth Director, emphasized the significance of this advancement, stating, "We can now understand what our audience is going to be from a value perspective on volume and also what they’re going to be watching." This insight is pivotal for their business. #databricks #ai Read more about Seven West Media's predictive analytics success here: https://lnkd.in/e4rb3_mp

174

4 Comments

Ready to improve forecasting by 20%? Quickly connect Snowflake’s new #Cortex Forecasting to PredictHQ’s Beam API and Features API to reduce mean absolute percentage error (MAPE) by 20%. Plus, get ready for even deeper explainability with our Events API coming soon to Cortex. Watch the demo where PredictHQ Chief Data Officer Dr. Xuxu Wang shows you how it works 👇 https://lnkd.in/ekR_xWZq #demandforecasting #predictiveAI

6

Now on Databricks Runtime 14.3: the State Reader API, a new capability that allows users to access and analyze Structured Streaming's internal state data. Discover how this new capability is providing much-needed transparency, accessibility, and ease of use: https://dbricks.co/3UeoF6l

214

Snowflake: Iceberg Dynamic Tables https://lnkd.in/gtCpgHgu

4

👏 Opendatasoft joins Databricks partner program 🤝 Opendatasoft today announced its partnership with Databricks, the data and AI company, becoming a Validated Databricks Technical Partner, enabling it to deliver innovative new ways to access data, and help organisations maximise value from their data programs. 🔄️ As a validated Databricks Technical Partner, Opendatasoft has developed an integration connector to enable its customers to seamlessly access and reuse data assets. ""We are focused on accelerating data use to increase productivity, enable better decision-making and reduce risk. This partnership offer users innovative new ways to access and harness information"" - Jean-Marc Lazard, CEO and co-founder, Opendatasoft. 🔎 Read the full press release here: https://lnkd.in/ey2nQP5F #data #dataportal #datademocratization

10

Want to experience faster loading with Neo4j? Check out Eric Monk's blog on parallel loading. #dataloading #neo4j #cypher

7

1 Comment

Struggling to find Databricks Data Engineers? 🕵️ We can source, train, and deploy these specialists to your business in just 10 weeks. 🎯 Find out more about our cost-effective, flexible, and tailored #Databricks talent development model here: https://lnkd.in/eS8yNmyh #Data #AI

4

Exciting news! Cortex Analyst now supports joins for Star and Snowflake schemas, empowering business users to generate insights from complex, multi-table data with ease. With a remarkable 92% SQL accuracy, Cortex Analyst surpasses other solutions, ensuring reliable answers for intricate queries. 🌟 Supporting joins in a text-to-SQL system is far from as simple as just joining two tables. It requires thoughtful handling of join paths, join types, disambiguation, aggregation, and distinctness, along with careful parsing to generate SQL that accurately reflects the user’s question. Learn more about our approach to solving these challenges while maintaining high accuracy: https://okt.to/VNhGXZ

157

7 Comments

Traditionally, businesses have managed transactional and analytical workloads separately, leading to inefficiencies. 𝗦𝗻𝗼𝘄𝗳𝗹𝗮𝗸𝗲 𝗨𝗻𝗶𝘀𝘁𝗼𝗿𝗲, a hybrid table, revolutionizes this approach by combining OLTP and OLAP into a unified platform. This innovative solution addresses challenges like data duplication, complex pipelines, and performance bottlenecks. By storing data in a single location, Unistore simplifies data management, reduces costs, and accelerates insights. 𝗞𝗲𝘆 𝗯𝗲𝗻𝗲𝗳𝗶𝘁𝘀 𝗶𝗻𝗰𝗹𝘂𝗱𝗲: - Unified dataset for improved decision-making - Enhanced application development capabilities - Reduced data latency and increased query performance - Strengthened data security and governance 𝗥𝗲𝗮𝗱𝘆 𝘁𝗼 𝘀𝘁𝗿𝗲𝗮𝗺𝗹𝗶𝗻𝗲 𝘆𝗼𝘂𝗿 𝗱𝗮𝘁𝗮 𝗼𝗽𝗲𝗿𝗮𝘁𝗶𝗼𝗻𝘀? 𝗗𝗶𝘀𝗰𝗼𝘃𝗲𝗿 𝗵𝗼𝘄 𝗦𝗻𝗼𝘄𝗳𝗹𝗮𝗸𝗲 𝗨𝗻𝗶𝘀𝘁𝗼𝗿𝗲 𝗰𝗮𝗻 𝘁𝗿𝗮𝗻𝘀𝗳𝗼𝗿𝗺 𝘆𝗼𝘂𝗿 𝗯𝘂𝘀𝗶𝗻𝗲𝘀𝘀. https://lnkd.in/dn7gia7Y #Snowflake #Unistore #OLTP #OLAP #data #analytics #technology #datacloud #cloudcomputing #businessintelligence

24

Will you be at the Databricks Data+AI Summit? Don’t miss the SqlDBM team this week. Visit booth 20 to learn about our all-in-one data modeling platform! 🚀 #Databricks #DataModeling #SqlDBM

24

2 Comments

Check out this insightful article on how open file formats shook up the Snowflake Databricks rivalry and created a new battleground: The rise of AI models and huge training data sets, security and governance tools could become a much bigger selling point https://lnkd.in/ewHyf2vJ

3

Ever wondered how data modeling could save your organization a fortune? 💰 Marcin Kulakowski from Snowflake sheds light on the surprising "Monetary Value of Data Modeling" and its significant impact on reducing system maintenance costs. He highlights that while data modeling is often undervalued, it’s a game-changer for minimizing errors and cutting maintenance expenses. Consider this: 75% of a data project’s lifecycle is dedicated to maintenance, and up to 28% of errors stem from incomplete specs. The real kicker? Proactive modeling can slash error correction time and lead to six-figure savings. Intrigued? Dive into the details here: https://lnkd.in/ex3Gjdpz #datamodeling #dataarchitecture #data

52

2 Comments

Snowflake Arctic, a new large language model that’s open, enterprise-grade, and efficient, is now available on Microsoft #Azure AI.   This state-of-the-art model uses a Mixture-of-Experts architecture that activates 50% or fewer tokens than comparably sized models. Arctic excels in a variety of tasks, including SQL code generation, sophisticated instruction following, and complex data analysis and is available for unrestricted personal, research, and commercial use.   We’re upholding our promise to deliver the best selection of high-quality models so our customers have choice and flexibility.     https://lnkd.in/g3mxCMfa #SnowflakeArctic#EraOfAI #GenAI

417

7 Comments

Materialized Views and Streaming Tables are now Generally Available in Databricks SQL! 🥳 In our internal benchmarks, Materialized Views delivered ~7x better data freshness at 1/50th of the cost of a similar CREATE TABLE AS statement. 👀 Read more here!

2

Super exciting recent SqlDBM update! ✨ The release of Tx - transformational modeling! SqlDBM is the first ever ultimate data modeling platform, combining Relational and Transformational modeling in one, built for Snowflake! ❄️ Message me if you’d like a demo! 🚀 #datamodeling #transformationalmodeling #dataengineering

16

1 Comment

ChaosSearch, as a Databricks Technology Partner, brings ELK use cases to Databricks ecosystem enabling centralized log and event analytics for observability and security. 🔒 Deliver on the best of Databricks (open Spark-based data lakehouse) and ELK (efficient search, flexible live ingestion, API/UI) via ChaosSearch on Databricks. Data ingested into Delta Lake format, all compute in Spark via Databricks and with the best of ChaosSearch’s hunting and Databricks’ AI/ML. Explore the power of ChaosSearch in your Databricks environment: https://lnkd.in/dSAXRgEF

4

❄️ Learn how to cut Snowflake data ingestion costs by 70% or more… ⚡️ …with much faster updates… . 👆 …and a single “source of truth” data copy, for all use cases. 🗣️🗣️ Ryan Garrett and Andy Walner of Onehouse explain it in in our webinar, three short weeks away. https://lnkd.in/ghsPrMv2 #onehouse #dataengineering #nolockin #datalakehouse #apachehudi #apachextable #opensource 

12

1 Comment