Holisticon Poland’s Post

Monday Morning ☕ calls for Orchestra's data roundup. It is also swiflty becoming a roundup of roundups too I guess as we like to include Christophe Blefari's newsletter in ours??? Check it out here ⚡ https://lnkd.in/ezV_wfVr 🧠 Stop being data-driven Cai Parry-Jones 🧠 Why did Databricks open-source Unity Catalog 🧠 7 surprising habits that make data engineers unstoppable Tim Webster 🧠 How to run Kafka on 100% object storage Vu Trinh 🎥 How to build a data infrastructure that lasts Benjamin Rogojan Seattle Data Guy and great content from Joe Reis 🤓 as always #dataengineering #dataroundup #datanews

https://lnkd.in/duFQhSJW On October 2, 2024 #Neo4j is hosting a FREE GraphSummit in Minneapolis. Along with Neo4j customer and SME presentations you can also listen to #Snowflake's Ravi Kumar and Zachary Blumenfeld from Neo4j talk about how both companies are bringing #GraphDataScience into the #AIDataCloud Neo4j’s Graph Data Science (#GDS) brings a robust library of #graphalgorithms directly to Snowflake. Now, Snowflake users can initiate a fully serverless, isolated, and flexible #graphanalytics environment directly from SQL using #Snowpark Container Services. #graphdatabases

🚀 New Video Alert: Data Orchestration with Airflow using Astro and BigQuery! 🚀 🎥 In my latest tutorial, I explore how to orchestrate data workflows seamlessly using Apache Airflow with Astro, and integrate it directly into BigQuery! Whether you're new to data pipelines or looking to optimize your data engineering processes, this video has you covered. 📌 Watch it here: https://lnkd.in/e6thTmc7 🙌 Don’t forget to like, comment, and hit subscribe for more tutorials on data engineering and beyond! #DataOrchestration #Airflow #Astro #BigQuery #DataEngineering #Automation

Data practitioners often comment that 80% of their time is spent cleaning and preparing data. In the first of a two part series Josh Miramant and William Huard dive into the frameworks that are enabling data engineers, data analysts, and data scientists to reduce time to insights, while ensuring data quality and visibility from ingestion through end user consumption. Stay tuned for part two where we dive into a demo showcasing the implementation of the medallion architecture inside databricks and the user friendly tools to monitor quality from end to end! #dataquality #databricks #deltalivetables #medallionarchitecture #declarativeETL #dbdemos

At Zeenea, we develop advanced connectors to automatically synchronize your metadata from all your sources. Today's connector highlight: Databricks 🚀 Zeenea collects both Databricks Hive Metastore and Databricks Unity Catalog metadata, including datasets and associated Fields, as well as any technical and operational metadata, and other documentation you may have provided at the field table level. More info 👉 https://hubs.ly/Q02vkhKm0 #zeenea #databricks #connector #data #metadata #hivemetastore #unitycatalog

Ready for Databricks #DataAIWorldTour? I'll be joined by Matt Crawley, Chief Data Officer at Lebara, to discuss how Lebara is thinking about #genAI, how they’re scaling enterprise #DataQuality, and how Anomalo is making it all possible. We’ll also share best practices for data leaders aiming to drive data modernization. If you're attending, let’s connect! #Databricks #DataOps #AI #MachineLearning #DataObservability #DataEngineering #DataLeadership

🇬🇧 We're thrilled to attend Databricks' #DataAIWorldTour on September 11 in London. 🔥 In addition to sponsoring the event, our very own Vicky Andonova is hosting a fireside chat with Matt Crawley, Chief Data Officer at Lebara. They'll dive into: ⚖ How Lebara automates enterprise #DataQuality at scale 🤖 How Anomalo's machine learning-powered platform makes it possible 🔎 Best practices for enterprise data leaders looking to drive data modernization Register today, if you haven't already, and we hope to meet you there! https://lnkd.in/gEh5d2mf #Databricks #Lebara #EnterpriseAI #AnomalyDetection #DataAnalytics #CDAO #DataOps #DataQuality #DataEngineering #DataObservability

#TechTuesday - Excited to learn about the Databricks Lakehouse Fundamentals this week. The Lakehouse architecture is quickly becoming the new industry standard for data, analytics, and AI. The course covers the interesting evolution of data engineering and an intro to data lake house, Lakehouse platform, Platform Architecture and Security Fundamentals etc. Highly recommend it to anyone making a foray into Big Data. https://lnkd.in/eE5Gjq9s

🚀 Excited to share that I've started using VARIENT to store semi-structured JSON data in #Databricks! 📊 This innovative approach is streamlining our data processing and analysis, providing a more efficient way to handle complex data structures. The integration with Databricks allows for seamless querying and transformation, enhancing our ability to derive insights from semi-structured data. We were storing billions of JSON data as string format in Databricks. Migrating to VARIENT is 8x faster and excited to see the performance boost. #BigData #DataEngineering #DataScience #MachineLearning #TechInnovation #JSON #DataStorage #databricks