Fernando J. Mora, Jr.

Matillion x Cortex components now GA 👀 "We are excited to announce that Matillion now supports all of the major Snowflake AI capabilities, in a no-code, easy-to-use platform providing a complete and powerful AI solution that integrates with existing data workflows." Get all the details here (or swing by booths 1517 and 2502 at #DataCloudSummit) https://lnkd.in/eQ3dHm7i #AI #DataEngineering #DataEngineer

72

2 Comments

NEW EPISODE ALERT: #HighImpact in #Databases High Impact in Databases with... ali dasdan is out now! Ali is CTO at ZoomInfo. Tune in to hear Ali's story and learn about some of his most impactful work such as his work on #MapReduceMerge Materials mentioned in this episode: - Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters (SIGMOD'07) [https://lnkd.in/e59VfRxS] - The Art of Doing Science and Engineering: Learning to Learn, Richard Hamming [https://lnkd.in/ewihCHzj] - How to Solve It, George Polya [https://lnkd.in/exWu-3CP] - Systems Architecting: Creating & Building Complex Systems, Eberhardt Rechtin [https://lnkd.in/eH9RpDfS] Disseminate is available on: - Spotify (https://lnkd.in/eHn-FaAF) - Apple Podcasts (https://lnkd.in/epQAjhYC) - Amazon Music (https://lnkd.in/ehCt8Ypr) - Acast (https://lnkd.in/enfTYV-V) - Website (https://lnkd.in/efRkNaez) - Pocket Casts (https://pca.st/h7y2m0cx) The #HighImpact series is sponsored by Pometry. Pometry are the developers behind #Raphtory, the open source temporal graph analytics engine for Python and Rust. #Raphtory supports time traveling, multilayer modelling, and comes out of the box with advanced analytics like community evolution, dynamic scoring, and temporal motifs mining. It is blazingly fast, scales to hundreds of millions of edges on your laptop, and connects directly to all your data science tooling, including Pandas, PyG and LangChain. Go have a play with the #Raphtory 0.8.0 release ➡️ https://raphtory.com The #HighImpact series was inspired by a blog post "Most Influential Database Papers" (https://lnkd.in/eAmVeKCd) by Ryan Marcus.

4

At Snowflake Data Cloud Summit? ❄ Mark your calendar now: You don't want to miss Dustin Shoup's session, How PayNearMe Leverages Snowflake's Partner Ecosystem to Ensure Data Quality and Quiet the Noise, today at 3pm! Dustin will discuss how his team leverages Snowflake’s technology partners to monitor his team’s entire environment from source to destination, quiet the upstream and downstream noise, and ultimately provide his clients with the insight they need to make more informed business decisions. You'll learn his approach to building a robust data platform, and how his approach to monitoring for data quality can help you identify problems before they wreak havoc on your pipelines. Learn more here: https://lnkd.in/gf8ZPVdv

22

🎙️ “𝗕𝗿𝗶𝗻𝗴 𝗩𝗲𝗰𝘁𝗼𝗿 𝗦𝗲𝗮𝗿𝗰𝗵 𝗔𝗻𝗱 𝗦𝘁𝗼𝗿𝗮𝗴𝗲 𝗧𝗼 𝗧𝗵𝗲 𝗗𝗮𝘁𝗮 𝗟𝗮𝗸𝗲 𝗪𝗶𝘁𝗵 𝗟𝗮𝗻𝗰𝗲” on the latest 𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝗶𝗻𝗴 𝗣𝗼𝗱𝗰𝗮𝘀𝘁 Tobias Macey interviews Weston Pace on a deep dive about the #Lance file and table format for column-oriented vector storage. 🗝️ Key Takeaways: 🗡️ 𝗟𝗮𝗻𝗰𝗲 𝗙𝗼𝗿𝗺𝗮𝘁: Learn about the optimizations made for fast random access and efficient schema evolution, and how Lance integrates seamlessly with data lake and lakehouse architectures. ➡️ 𝗔𝗿𝗿𝗼𝘄 𝗘𝗰𝗼𝘀𝘆𝘀𝘁𝗲𝗺: Discover how #LanceDB is a first-class participant in the Apache Arrow ecosystem, making it easy to use with your existing #ML and #AI toolchains. 🗃️ 𝗩𝗲𝗰𝘁𝗼𝗿 𝗗𝗮𝘁𝗮 𝗠𝗮𝗻𝗮𝗴𝗲𝗺𝗲𝗻𝘁: Understand the core problems LanceDB is designed to solve, including efficient storage, querying, and retrieval of vector data. 💼 𝗣𝗿𝗮𝗰𝘁𝗶𝗰𝗮𝗹 𝗨𝘀𝗲 𝗖𝗮𝘀𝗲𝘀: Hear about the most interesting and innovative ways LanceDB has been used, and the lessons learned from its development. Listen to the episode: https://lnkd.in/gEG4pp7n

9

Moving from Redshift to Databricks is more than just a migration. Read Part 1 of our Comprehensive Guide, where Nicanor Medina explores the benefits, challenges, and planning steps for a seamless migration to Databricks. Ready to make the switch? #DataEngineering #CloudMigration #Redshift #AWS Databricks https://lnkd.in/d9w7t3vd Kailash ( Kai) Thapa | Josue A. Bogran | Santiago Carrera

19

Discover how Snowflake is heating up their ABM efforts this Summer with the power of Company Surge® Intent data! Building on the tremendous success of their One-Team GTM approach, Snowflake is now ramping up their strategy. If you're aiming to launch or expand your ABM strategy next quarter, Snowflake’s straightforward five-step playbook is a great place to start - SDRs begin their outbound motion within two weeks of campaign launch for timely outreach! Check out the full breakdown here: https://hubs.ly/Q02M3pdY0 #Intentdata #ABM #B2Bmarketing #B2BSales #GTMstrategy

15

Article 1 of 3: Tungsten Clustering versus Galera Cluster Matt Lang, Director of Customer Success at Continuent, published a series of compelling articles about the key differences between Continuent Tungsten Clustering and Galera Cluster (aka MariaDB Cluster and Percona XtraDB Cluster.) In the first of three articles, we explore the performance benefits of switching from Galera Cluster to Tungsten Clustern. It explains that by using asynchronous replication, Tungsten Clustering, achieves improved application performance through reduced delays, better handling network latency, and scaling more efficiently. Unlike synchronous replication, which waits for transaction confirmation from downstream nodes, asynchronous replication allows immediate transaction commits, minimizing latency and enhancing performance, especially in high-transaction  clusters. The article also highlights that multi-master setups in synchronous replication can actually hurt performance, whereas asynchronous replication is more efficient due to less overhead. Article two will cover geo-scale (multi-site cluster) deployments. Read more here: https://lnkd.in/gSErtj5y

1

RevOps teams discovering how their shiny new tech actually calculates their metrics: Yes it's spooky season but the way your critical recurring metrics are calculated shouldn't be a nasty surprise. Get a sturdy, flexible app that calculates your ARR, MRR, ACV and other metrics on formulas you can see, understand, and easily adjust to your needs before and after your initial implementation. Don't let "what's in the boooooox?!?!?!" give you a fright. See it for yourself with ARRow. Link to our AppExchange with demo video, use case, and more on how we simplify your metrics in the comments!

3

1 Comment

We have out-of-the-box support in LlamaIndex for Snowflake SOTA arctic-embed models (which outperform other leading embedding models in benchmarks) - it's a one-liner through our Hugging Face integration! And in ~4 more lines of code, you can build a RAG indexing pipeline over your data with these embedding models. Check out the screenshot below for how to get up and running with this - we might have more detailed benchmarks soon, stay tuned 💡

213

3 Comments

Databricks is “doubling down” on working with its systems integrator partners, with co-founder and CEO Ali Ghodsi viewing services partners as an important part of the vendor’s go-to-market and widespread adoption of artificial intelligence tools. “The AI revolution is not going to happen without the SIs,” Ghodsi said during a Q&A session at the Data+AI Summit. Here’s what else he said during #DataAISummit:

15

1 Comment

Cube now has a fully supported integration with Klipfolio PowerMetrics - a cool metrics platform that teams up with your current BI and analytics tools to make life easier for non-techy business folks. 📊 👨‍💻 Take a look at our latest blog post: https://lnkd.in/gfT_fiwW #BI #Analytics #Tools

2

We’re thrilled to share that Monte Carlo was included in the DBTA 100 2024: The Companies That Matter Most in Data! 🎉 If you’re at Databricks Data + AI Summit this week, be sure to stop by Booth #125 to learn more and chat trusted data and AI. Check it out: https://lnkd.in/eTJVcHaj #dataobservability #AI #GenAI

30

1 Comment

Discover with Cedrik Neumann how to harness Apache Airflow plugins to run tasks within a profiler and access custom metrics through operator links and custom views. Get inspired by ideas for making task metrics more accessible in Airflow's future! 🚀 https://airflowsummit.org/ #airflowtask #airflowmetrics #dataorchestration #batchprocessing #dataprocessing #datapipelines #data #datasience #opensource

10

🚨 Hot off the press! 🚨 Observability Digest #010 is out now! 📰 https://lnkd.in/eZ8Wa5kS In this edition, we dive into the latest observability trends and innovations, including: 🔍 Snowflake's acquisition of TruEra's AI observability platform 🤖 Logz.io's AI-driven chatbot for smarter observability 💰 Revefi's $10.5M funding for AI cloud data observability tools 📊 Hydrolix's innovative approach to log data storage We also explore the critical intersection of security and observability with insights from Dynatrace and Raconteur. 📚 Don't miss our featured tutorial by the talented Kaivalya Apte. This tutorial provides a step-by-step guide to pinpointing issues in systems using observability techniques. 🥪 In our Expert Voices section, Tiago Dias Generoso creatively explains observability in IT operations through the workings of a sandwich shop. It's a must-read for anyone looking to grasp the practical value of observability. 🔮 Looking ahead, our next issue will delve into practical data tiering strategies to help you prioritize data efficiently for quicker access. 📧 Subscribe now to stay at the forefront of observability and tech resilience #ObservabilityDigest #Observability #TechResilience #AI #DataTiering #LogManagement #Cybersecurity

2

2 Comments

We're live with our Deep Dive on Metronome with Founder/CEO Scott Woody! Metronome - the billing platform powering OpenAI & Databricks 🔋 In this conversation, Scott shares the story behind Metronome, the technical challenges they’ve overcome to serve high-scale customers, and what’s next as they continue to refine their platform to meet the needs of smaller businesses. Link below 👇 https://lnkd.in/eqjErtRi

11

ABAC is a common use case on Databricks, but how do you automate it for scale? Predefined masking rules, combined with automated data classification and tagging, make this task way easier. David Levy Nahum and Aviv David's new blog goes through exactly how the process works in Satori: https://lnkd.in/de8VWCWU

14