Chet Kapoor

Lately, we have observed a transition from Cloud Databases(Snowflake etc) to Iceberg OpenLakehouse format. Ambaricloud team is working on Snowflake to Iceberg Automation and end-user training. Why: Low-cost computing. SF is still a favored engine for Gold layer data. Less stickiness. More engine options to run on Iceberg tables. Cloud storage Parquet files Iceberg table format Catalog Status: Polaris -- Started Walking. Hopefully, it will Jog or Run soon! UnitCatalog -- Infant Glue -- Safe bet for now. Comments? Snowflake Cloudera Dremio Upsolver Databricks

8

1 Comment

Snowflake and Microsoft are working together to make it easier for businesses to connect and share data between Microsoft’s workplace tools, like Dynamics 365 and Power Platform, and Snowflake’s data storage system. This partnership allows organizations to access and analyze their data more seamlessly, without needing to build complicated custom workflows. For HR professionals, this could mean faster, easier ways to pull together employee data, performance metrics, or insights from multiple systems, saving time and simplifying decision-making. The tool is still being tested by select customers and will be widely available next year.

7

Really interesting read on the evolution of Data Warehouses, Data Lakes and Lake Houses and how Databricks and Snowflake are battling for the top spot. https://lnkd.in/egg4P5VG This is one of the more complete analysis I've seen on the evolution of the analytics space and it's big gorilla's. In the end, it gets into the AI discussion of big LLM's vs. small models and how SLM's will have a place in the analytics world, which I completely agree with.

9

1 Comment

At #KafkaSummit Bangalore, Confluent CTO, Chad Verbowski, spoke about how legacy data platforms not only limit efficiency and scalability, but also makes managing data more costly. And now with widespread AI adoption, access to fast and accurate data is critical. Highly recommend reading more of Chad’s insights if you’re interested in learning more about data streaming’s business impact. https://lnkd.in/g44ag34r #DataStreaming #AI #RealTimeData

27

.@Amazon Web Services Evolves SageMaker into a Unified Data Platform Centered On AI https://buff.ly/4ilfcnT @DHenschen shares the key takeaways from the Amazon SageMaker announcement from @AWSreInvent. #reInvent @awscloud

5

Great presentation on how Andrius Mazeiva at #adform gets great #performance by using #aerospike https://lnkd.in/exVqH6Tj you can learn more on this webinar as well https://lnkd.in/e89x_au2

7

Congratulations Sridhar, and Jensen, on your partnership to integrate NeMo into Cortex AI. This is a huge step to build custom AI apps. We have integrated #denodo platform with Snowflake #Arctic and #Cortex for building powerful #RAG applications, and are demoing this at our booth in the #datacloudsummit. As you know, relevant corporate #data is essential for #enterprise AI. To that effect, today, we proudly announced integrating NVIDIA NIM Interface Microservices with Denodo to accelerate and optimize #ai capabilities for enterprises. This integration will provide enterprise customers with faster, more secure, and fully scalable AI capabilities. https://lnkd.in/gqgwZ5Dh Looking forward to our partnership with Snowflake and NVIDIA to further the #ai innovation for our enterprise customers! #datavirtualization #logicaldatamanagement

66

1 Comment

🌟 Rise of the AI Integrators: Roadmap to Business Impact with Generative AI 🌟 In this blog we discuss how can #SystemsIntegrators partner with Google Cloud as they help their customers realize higher levels of business value with GenAI Beyond the rather commoditized tasks for summarization, content generation etc., 🔹 Generative U/X: Revolutionizing user experiences with AI-driven creativity. 🔹 Hyper-Personalization: Tailoring experiences to individual preferences using AI. 🔹 AI Amalgamation of Data: Integrating diverse data sources for powerful insights. 🔹 Agentic AI Business Process Automation: Streamlining operations with intelligent automation. 🔹 Next Best Actions: Generating strategic recommendations for impactful decisions. 🚀 Key Takeaway: Google provides solution completeness for all AI integrators at ask stages of their AI and Data journey 🚀 in depth discussion of differentiating capabilities that are essential to AI Integrators for leveraging generative AI to drive business success for themselves and their clients #AI #GenerativeAI #BusinessImpact #Automation #Innovation Cc: Kevin Ichhpurani Victor Morales

52

3 Comments

It's not easy to get AI into production and make it cost-effective, especially at massive scale. Read about how ASAPP is fundamentally changing customer service with AI and #ApacheAirflow...

26

🚨 Databricks Game Changer 🚨 Row and Column Level Security for Unity Catalog -- For the first time on any platform, you can apply fine-grained access controls across Apache Spark, data warehousing, AI, and real-time processing—all within a single platform.

11

Our commitment to AI-driven solutions and strong alliances with Snowflake and Databricks are enabling significant advancements in data management and analytics. Check out this SiliconANGLE & theCUBE article where Rob Strechay and George Gilbert discuss how Informatica remains at the forefront of data management, consistently driving innovation and customer success:

2

“We realized that AI & ML needed to be our competitive advantage and we knew that if that’s our vision, we couldn’t function like a traditional automotive company, we needed to become a software company … our data ecosystem is complex, so we needed to build GM’s Insight Factory right … [partnering with Databricks and other leading solutions], Atlan’s governance solution helps us with end-to-end lineage to understand our ecosystem.” What an inspiring keynote at the hashtag#DataAISummit from Brian Ames - Leading AI/ML from concept to Production, Head of the AI Center and Senior Manager for Transformation and Enablement at General Motors. We’re honored to partner with Databricks to support incredible joint customers like General Motors. Brian and the team at GM are transforming their industry and already achieving significant business impact with time-to-insight down from 28 days to 3 hours and $330M added to their bottom line.

20

Ever wondered who benefits from data cataloging? Well, it's more than just the #CDOs, and it can do more than just helping users find, identify and classify datasets. Informatica explains it all here:  https://infa.media/4fC49p3 #datacatalogs 

5

Databricks SQL Serverless is now generally available on Google Cloud! Unlock instant, elastic compute and elevate your data analytics with faster query performance and reduced costs. Focus on delivering insights that drive business value, rather than managing infrastructure. Available across 7 GCP regions and 40+ regions globally, SQL Serverless brings you the best of both worlds—unmatched performance and simplified analytics. Learn more here: https://lnkd.in/eZCu4VAJ

2

❄️ Come and hear how Snowflake uses DataOps.live for massive productivity gains for all its engineers. #data #dataops #analytics #dataproducts

10

First, I'm thrilled for Ryan Blue and the entire Tabular team on their transition to Databricks—a move that aligns them with an exceptional company. My admiration for Databricks, Ali Ghodsi, and the founding team has always run deep, particularly as an entrepreneur with an academic background Regarding the future of Iceberg as an open-source project, there are several potential trajectories, both short and long term: 1. Databricks might initially invest in Iceberg and forge a strong integration with Delta, thereby extending its reach to Iceberg's user base. Such synergy could greatly benefit Databricks. 2. Regrettably, the acquisition may understandably convey a message (right or wrong) to the community that Iceberg's future looks uncertain. Databricks could gradually phase out the project in favor of Delta over the coming years. Maintaining two products with similar functionalities might not be feasible. However, there's hope that other Iceberg PMC members will step up to sustain it. 3. Other companies, such as Snowflake and Dremio, which have heavily invested in and built upon Iceberg, may opt to fork the project to ensure democratic governance. It wouldn't be surprising if Snowflake had also pursued acquiring Tabular. The unfolding dynamics will indeed be fascinating to observe. Overall, I view Databricks' move as very smart. It's important not to fault the Tabular team for their decision; they acted in the best interest of themselves and their team. I'm confident they'll endeavor to preserve Iceberg's legacy. Nevertheless, in the realm of business, pragmatism often prevails. #databricks #apacheiceberg #datalake #acquisition #lakehouse

16

Scott Hild shared this amazing podcast with me. It's a must listen; and really easy to follow along. Adoption of AI is happening quickly, but not without the foundational work of getting your data in order. There is no AI strategy without a Data strategy. Your data strategy is the fuel for the AI fire your setting up for long term needs. #data #datatransformation #llm #sql #AI

8

2 Comments

Informatica launches GenAI blueprints to accelerate GenAI development on leading technology platforms! These blueprints, designed to make it easier and faster to build enterprise-grade AI applications, are now available for Amazon Web Services (AWS), Databricks, Google Cloud, Microsoft Azure, Oracle Cloud and Snowflake. Key capabilities include: ✅ Ecosystem-specific recipes ✅ No-code tools for quick deployment ✅ Seamless integration with IDMC for AI-ready data ✅ Built-in security and governance for responsible AI Learn more about how we’re simplifying GenAI development.

12