Justin Borgman

If you are ingesting data from Kafka/Kinesis into Snowflake you should watch this short video by Charles Tan and Shawn Gordon on how you can use DeltaStream to shift left your workloads to reduce cost and latency! #Flink #Kafka #Snowflake #ShiftLeft https://lnkd.in/gnZ45MTa

13

✨ Master AI in Snowflake: Enhance Your DBT Workflow ✨ Our Senior Data Engineer, Jaime Andres Salas, guides you in integrating LLMs with Snowflake Cortex into your DBT transformations. Key points: 🔹 Sentiment analysis with AI 🔹 Join sentiment data with reviews 🔹 Create recommendations for feedback https://hubs.ly/Q02BX1sW0 👉 Read the full article #AI #Snowflake #DBT #DataScience #LLM

8

Same Chicken (Iceberg), different Curries (Engines) Cloudera: Read Snowflake Data from Polaris External Sync Catalog I am able to "read" and integrate Snowflake data through Polaris with other data in Cloudera Spark. Cloudera Snowflake

17

We are LIVE at PASS Data Community Summit! Join us for Day 1 of Postgres Conference Seattle for a "Journey through Postgres" w/ Zak Tedder in Rm 420 or "Tips and Tricks for developers moving to PostgreSQL" w/ Eric Lendvai in Rm 422. Check out the full schedule here https://lnkd.in/estNqRHm #Community #Postgres #Data #peoplepostgresdata

1

Our data science team is made up of innovative and hardworking individuals who look to solve problems in scalable ways. In a recent blog post, Director of Data Science Jennifer Brussow broke down a recent example of this — when the team deployed an open-source LLM to scale batch calculations in Snowflake, our data warehouse. To read more about the development process, check out her blog post: https://bit.ly/4fitcwW #DataScience #DataScienceJobs #Snowflake #LLM #Hiring

12

1 Comment

Our last poll was about data and transparency. Today, Databricks has created The State Reader API , a new capability to help users have access and analyze internal state data for full transparency and ease of use __ Will this new capability make a real difference from what we are used to use so far? #Databricks #Newcapability #datatransparency #accessibility #easeofuse #nuboTed

2

2 Comments

DVT recently hosted Dael Williamson, EMEA CTO of Databricks, in an Insights Webinar focused on the critical role of interoperability in AI-driven business strategies. The webinar offered practical steps for CIOs and IT executives aiming to enhance their organisation's interoperability. DVT, as a strategic partner of Databricks, is uniquely positioned to help businesses unlock the full potential of these technologies. Webinar link - https://lnkd.in/dtWtedQP. #ai #databricks #webinar #technology #cto Karen Heydenrych Dantes de Beer

5

We'd like to show you what Veza can do for critical enterprise systems, please reply in comments for systems you'd like to see and we'll start sharing some! Starting with ... "who can take what action on what data in Snowflake" Permissions unlocked on Snowflake! https://lnkd.in/gSxhH43f #cybersecurity #identitysecurity #IAM #IGA #PAM #VEZA

59

3 Comments

Implys real-time analytics database platform, built on Apache Druid, seamlessly complements Apache Iceberg. This integration enables data stored in Iceberg table format to be ingested into Druid for real-time analytics. Leveraging Druid's robust querying capabilities alongside Iceberg's efficient data management and storage features. Read more about the integration here: https://lnkd.in/exEanSG5

7

Developers can now store, index, and query vectors in PostgreSQL using pgvector, eliminating the need for a dedicated vector database. This blog from Yugabyte expert Brett Hoyer deep dives into pgvector, and explains how to store text embeddings as vectors, execute similarity search, choose between indexes, and scale with distributed SQL.💡 Find out more!⬇️ https://hubs.la/Q02JyYrM0 #YugabyteDB #pgvector #vector #AI #Postgresql #cloudnative #distributedsql

5

Have you tried running the DBRX models from Databricks? In our latest blog post we provide a tutorial to get you started with the model on Ori’s public cloud. We were very impressed with DBRX’s performance on the Hugging Face Open LLM Leaderboard before the updates last week. While DBRX Instruct did not score as highly under the new scoring system, it's still one of the best open models for Language Understanding (MMLU), Programming (HumanEval), and Math (GSM8K). We also used BeFOri, the benchmarking framework from Ori to determine DBRX Base performs inference most efficiently between 40 and 256 concurrent requests on one of Ori's 8 x H100 PCIe bare metal servers. Check out the blog to learn how you can use BeFOri to optimise self-hosted LLM performance on any infrastructure! https://lnkd.in/gi55WEks

43

Databricks is “doubling down” on working with its systems integrator partners, with co-founder and CEO Ali Ghodsi viewing services partners as an important part of the vendor’s go-to-market and widespread adoption of artificial intelligence tools. “The AI revolution is not going to happen without the SIs,” Ghodsi said during a Q&A session at the Data+AI Summit. Here’s what else he said during #DataAISummit:

15

1 Comment

🌐 Boost Your Workflow with AI! 🌐 Our Senior Data Engineer, Jaime Salas, explains "Mastering AI in Snowflake: Transform Your DBT Workflow!" on the Infostrux Engineering Blog. 📘 Highlights: -Utilize LLMs with Snowflake Cortex -Integrate AI into DBT -Practical examples 🔗 Read more: https://hubs.ly/Q02BX71b0 #Snowflake #AI #DBT #DataScience #TechInnovation

9

Want to learn more about how to get started using Snowflake Cortex LLM Functions? Check out this post from Jon Coulter detailing how to use these tools to quickly classify data, empowering Data Engineers with Data Science tools! https://lnkd.in/gMTFT5xQ

14

Open has become the state-of-the-art (for now), Meta have changed the game - yet again - with the release of the Llama3.1 suite of models. The acceleration in this industry is breathtaking. The headlines: * Llama 3.1 models are immediately available in Cortex today. ✅ * 405B packs a punch - out performing other leading flagship models across a variety of benchmarks. 📈 * 8b & 70b models have been updated too. The already capable models have seen significant jumps, particularly in math and coding, in just 3 months. 🚀 * Meta's 3.1 suite will be made available for serverless fine tuning. 🤯 * We've also released Snowflake Cortex Guard (GA) to safeguard LLM applications. 🛡

8

3 Comments

✨ If you have Databricks, do you need Snorkel AI? If you plan to customize #LLMs with your own enterprise data the answer is an easy yes. You need high quality data to build production-quality AI, but most unstructured enterprise data is inaccurate, incomplete, and inconsistent. Often you have a lot of data for common scenarios but very little for high-value edge cases (obviously!). Good news: Snorkel Flow integrates seamlessly with Databricks at every stage of the AI development workflow, from accessing data & models to deploying production-quality applications via Unity Catalog. For a guided walk-through check out this 5min demo and learn more at https://lnkd.in/gTiQ4wD8 #AIInnovation #ArtificialIntelligence #dataintelligence

31

7 Comments

Discover how Wavicle helped Pilot Company transition to a unified data framework with Amazon S3, Databricks, and Snowflake, cutting latency and reducing costs for faster, cost-effective analytics and better decision-making. https://hubs.la/Q02KNPYD0 #cloudmigration

15