Irmak Fite

📣 At Databricks, we want to help customers build more #inference-friendly #llms. Our MixAttention architecture demonstrates that reductions in KV cache size make it possible to maintain model quality while improving inference speed and reducing memory footprint. Read our latest blog post to learn more: https://lnkd.in/gcHxM4DX

133

3 Comments

Join PyTorch at Snowflake's #DataCloudDevDay on June 6 in San Francisco to learn how to accelerate GenAI performance with Native PyTorch. Register: https://hubs.la/Q02xQStt0

18

We are LIVE at PASS Data Community Summit! Join us for Day 1 of Postgres Conference Seattle for a "Journey through Postgres" w/ Zak Tedder in Rm 420 or "Tips and Tricks for developers moving to PostgreSQL" w/ Eric Lendvai in Rm 422. Check out the full schedule here https://lnkd.in/estNqRHm #Community #Postgres #Data #peoplepostgresdata

1

Next Tuesday, October 22 at Druid Summit, learn how to ingest data from #DeltaLake tables into Apache Druid using the druid-delta-lake-extensions. Venki Korukanti (Databricks) and Abhishek Balaji Radhakrishnan (Imply) will also cover the new Delta input source ingestion capabilities. ✅ Learn more & register today! 👉 https://lnkd.in/eeajHAR4 #opensource #oss #linuxfoundation #lfaidataa #druidsummit

28

1 Comment

We’re thrilled to partner with AI at Meta to release the Llama 3.1 series of models on Databricks – available to our customers today. These models expand context length to 128K, add multilingual capabilities, and include Llama 3.1 405B — the largest and highest-quality openly available foundation model. With this release, customers can serve and fine-tune the Llama 3.1 models, connect them to our RAG and agentic systems, easily generate synthetic data to better customize their models, and leverage them for scalable evaluation. We have integrated Llama 3.1 throughout our Data Intelligence Platform. https://dbricks.co/4dcJpC3

736

10 Comments

Databricks Announced the GA of Serverless Compute for Notebooks, Workflows and Delta Live Tables ! This would immensely help Customers with: ➡Rapid workload startup ➡Automatic infrastructure scaling ➡Seamless version upgrades of Databricks runtime ➡Cost Savings, billed only when compute is assigned to your workloads and not for the time to acquire and set up compute instances. Fast ! Simple ! Reliable ! Databricks Digivate Labs https://lnkd.in/gHNF6SGB #Databricks #Serverless #Datalakehouse #DataEngineering #DataScience #Datalake

10

Follow along John Chun Hong Leung's new tutorial to learn how you can ingest, extract, and visualize time-series data by using PySpark on Databricks (implementation code included).

24

Discover how Wavicle helped Pilot Company transition to a unified data framework with Amazon S3, Databricks, and Snowflake, cutting latency and reducing costs for faster, cost-effective analytics and better decision-making. https://hubs.la/Q02KNPYD0 #cloudmigration

15

Our last poll was about data and transparency. Today, Databricks has created The State Reader API , a new capability to help users have access and analyze internal state data for full transparency and ease of use __ Will this new capability make a real difference from what we are used to use so far? #Databricks #Newcapability #datatransparency #accessibility #easeofuse #nuboTed

2

2 Comments

“From data chaos to clarity” – At Confluent, that’s exactly how we see data streaming untangling data complexities. At #KafkaSummit Bangalore, Jay Kreps, Co-Founder and Chief Executive Officer, and Shaun Clowes, Chief Product Officer, spoke to Frontier Enterprise's Rahul Joshi about the not-so-secret but powerful weapon that helps businesses turn brittle data infrastructures to streamlined, efficient systems. Spoiler alert: It’s a data streaming platform! 😉 When you’ve got a platform that works as an intelligent connective tissue - enabling #realtime data and simplifying data integration across the organization - data sets truly become more than the sum of their parts. 🧩 Read more ⬇

45

Databricks partners with Amazon Web Services (AWS) to enhance custom AI model development using Mosaic AI and AWS Trainium for scalable solutions. read more: https://lnkd.in/dkad5ZwQ Ali Ghodsi | Matt Garman | Stuart Wright #generativeai #mosaicai #aiapplications #cloudcomputing #dataanalytics #datasecurity #machinelearning #modeloptimization #adtechtoday

7

Learn how Amazon used Ray on EC2 to process exabytes of Parquet data with 82% better cost efficiency than Apache Spark. 👉 https://lnkd.in/gWjc9kpr Amazon Retail's Business Development Team just flipped the switch to start quietly moving management of some of their largest production business intelligence (BI) datasets from Apache Spark over to Ray to help reduce both data processing time and cost. #AWS #opensource

3

Exciting news that Glean and Databricks have recently partnered to bring natural language data discovery and analysis to the forefront! Utilising Databricks AI/BI Genie’s cutting-edge structured data capabilities, Glean Assistant users can now perform complex queries seamlessly. Key Benefits: 🔹 Natural Language Processing for Data Queries 🔹 Secure Access with Databricks’ Unity Catalog 🔹 Efficient Workflows Without Additional Help Consider a marketing manager seeking insights on subscriber churn. With Glean and Genie, they can now independently get all the answers in minutes. "Databricks AI/BI offers a new paradigm for business data and analytics," says Adam Conway, SVP of Products at Databricks. Arvind Jain, CEO of Glean, adds, "Our integration with Genie will unite structured and unstructured data, enhancing user interaction and maintaining security." Stay informed and see the power of this integration in action—request a demo with intelia today! We're implementation partners of both Glean and Databricks. #DataIntegration #AI #Databricks #Glean #EnterpriseData #Genie https://lnkd.in/geijX8Ke

39

We just launched a native Snowflake connector that cuts processing speeds AND costs in half by integrating SQream Blue's GPU-accelerated technology. Benchmarked by the TPCx-BB analysis, SQream Blue outperformed Snowflake, handling 30 TB of data at 2X the speed and 1/2 the cost. This connector allows users to seamlessly integrate SQream’s platform into existing Snowflake workflows, reducing data transfer needs and optimizing cloud spend. Experience efficiency like never before with SQream Blue.

20

The future of data is about breadth, not just volume. 📊 Google Cloud’s Gerrit Kazmaier, VP & GM, Data & Analytics, and Rayn Veerubhotla, Managing Director, Partner Engineering, sat down with Cloud Wars Live to discuss this new era of wide data. They talk about the transformative potential of Google Cloud’s data cloud solutions, the integration of real-time data capabilities, and the role of strategic partnerships in driving value for enterprises. Want to learn how this new approach to data can benefit your organization? Check out the full interview → https://goo.gle/4gUqX3L #GoogleCloud | #CloudWars | Cloud Wars (Acceleration Economy) | Bob Evans

27

1 Comment

Llama3 on Databricks. Databricks is changing the game with making open models easily usable.

1

Matillion x Cortex components now GA 👀 "We are excited to announce that Matillion now supports all of the major Snowflake AI capabilities, in a no-code, easy-to-use platform providing a complete and powerful AI solution that integrates with existing data workflows." Get all the details here (or swing by booths 1517 and 2502 at #DataCloudSummit) https://lnkd.in/eQ3dHm7i #AI #DataEngineering #DataEngineer

72

2 Comments

Unveiling Snowflake and Databricks governance frameworks 🌐 In the latest episode of #theCUBEpod, David Vellante and John Furrier dig into Snowflake and Databricks governance infrastructure and strategies. “I think [Databricks’ CEO] Ali Ghodsi is right that Snowflake doesn't want to open up, and [Snowflake co-founder] Benoit Dageville admits this. They got to go where the customers are. So, the market's going to stay very fragmented, and I think that long-term, to the extent that stays the case, that does favor Snowflake. It will force customers, if they want integration and tight governance, to stay with Snowflake,” Vellante shares. He continues, saying “the other thing is that Databricks bought Tabular for a couple billion dollars. They don't own Iceberg, which is open source, but they have talent. Ali's going to take that talent and he's going to try to bring Delta and Iceberg together. Those are the open table formats to create a unified governance framework that you can apply Unity to, and then sell the Databricks tooling behind that. That's their strategy.” “Very different strategies. If the open source community can deliver on that promise, that's an advantage for Databricks. But I do think that's going to take some time,” Vellante concludes. 📺 Get into the complete analysis: https://lnkd.in/gJmArZdh

9