Raj K.

At Confluent's Kafka Summit in Bangalore, Shaun Clowes, Chief Product Officer, and Jay Kreps, Co-Founder and CEO, discussed Confluent's strategic approach to enhancing enterprise data infrastructure amidst the AI revolution. "Every time you have a new data need, what do you do? You connect the destination point-to-point to all the different sources needed. Over time, your data infrastructure turns into a giant, tangled mess of interconnections," shared Shaun Clowes. “Kafka often serves as the data feed into this area. However, when considering the various tools available, they generally run on not just streams, but largely on extensive tables of data. This is the essence of a data warehouse or data lake," Jay Kreps explained. #BigData #DataManagement #DigitalTransformation

2

Excited to share that Vijay K. and I collaborated on a guide for Active-Active Replication on Amazon RDS for MySQL! This comprehensive resource is now available on AWS Solutions https://lnkd.in/d2nH2NH3 #aws #amazonrds #mysql #highavailability #disasterrecovery #rds #mysql

25

1 Comment

Explore how Snowflake Cortex's Classification ML function empowers financial services to tackle account churn and enhance customer segmentation effectively. 🔄 Learn more about leveraging data-driven insights to stay competitive: https://lnkd.in/diTQiwJX #Snowflake #KipiIndustryWeek #FinancialSolutions

8

 I’m excited to speak along with Saptarshi Mukherjee at @Snowflake’s #DataCloudSummit ❄️in June. Stop by my session, Unify Customer Data, Deliver Exceptional Experiences and Delight Customers with Snowflake and Salesforce, at 03-June 3:30 PM to learn more about Salesforce Bi-Directional Zero Copy Integration and using DOCAI to analyze unstructured files to achieve C360 https://lnkd.in/gC8kHmVr

35

1 Comment

Curious how to use Apache Hudi & Iceberg tables in Databricks environment? Check out this hands-on blog by Dipankar Mazumdar, M.Sc 🥑 that shows how to use Apache XTable to interoperate between the 3 table formats in a lakehouse architecture. 🔗 Link: https://lnkd.in/dwTdBinz #dataengineering #softwareengineering

17

1 Comment

When managing Snowflake at scale, it can be difficult to balance cost and performance. Capital One Slingshot makes it easier, building on tools we created internally to help our own teams streamline provisioning, optimize workloads and reduce query inefficiencies. See how Slingshot can help you maximize your #Snowflake investment. https://bit.ly/3AK2gGZ

1

Vishnu Vasanth will be discussing a fresh approach to building high-performance lakehouse compute engines for open table formats like Delta Lake, Apache Iceberg, and Apache Hudi at The Fifth Elephant 2024 Annual Conference. 🔍 Dive deep into: 1. Overcoming challenges with distributed compute engines like Apache Spark, Trino Software Foundation/Presto Foundation, and Apache Flink. 2. Implementing a Kubernetes-native, decentralized architecture for better performance. 3. Achieving high concurrency, complex queries, and handling massive data volumes with ease. Why attend? 1. Learn about a hyperefficient compute engine. Gain insights on eliminating single points of failure. 2. Understand how to maintain deterministic tail latencies and efficient cluster utilization. 🎟️ Don’t miss out – Buy your ticket or pick a membership now. https://has.gy/Naw4 #BigData #DataScience #MachineLearning #TheFifthElephant #DataLakehouse #DeltaLake #ApacheIceberg #ApacheHudi #Kubernetes Ververica | Original creators of Apache Flink®

2

#AI #ML #Analytics Being a part of right WhatsApp channels can help you get the right info at a right time. Like this - https://lnkd.in/g_JFJgA5

5

Fast-growing undo logs in #MySQL can degrade performance by increasing disk and memory usage, causing contention, slowing checkpointing, and extending rollback times. Monitoring and adjusting settings like innodb_undo_logs_size and undo_log_size can help manage undo log growth. #MySQLPerformance @MinervaDB #dba https://zurl.co/5Bmh

10

Checkout latest lab session from my YouTube channel Cloud Quick Labs..👇 ETL is key IT workload now across all enterprises(Analytics, Reporting, AI/ML). Below lab shows how you can migrate your Amazon Web Services (AWS) RDS MySQL DB to Amazon Redshift Datawarehouse using AWS Glue ETL pipeline. Do watch, try it and subscribe for more learning. #aws #rds #redshift #etl #datawarehouse ##datamigration #cloudquicklabs https://lnkd.in/gqrd2QiR

1

It gives us great pleasure to announce that Apache Spark in BigQuery is now officially available in Private Preview. This feature expands BigQuery’s processing capabilities by offering Apache Spark as an OSS processing engine under a unified control plane (admin, monitoring, billing, security, governance). It is the first step in delivering on the Unified Data Platform vision and was a key announcement at Next ‘24 #googlecloud #bigquery #spark

38

2 Comments

❄DATA CLOUD USER GROUP❄ As luck would have it, our next Snowflake Dallas User Group topic (which was selected several weeks back) is quite timely in light of recent events. 📣 Join us next Tuesday (May 28) to hear Sanjay Kattimani talk about business continuity and disaster recovery. Sanjay will give us a detailed exploration of Snowflake's disaster recovery capabilities, where he will delve into the advanced mechanisms designed to protect your data from unexpected disruptions. Our session will kick off with an in-depth look at Snowflake's features that enhance data resilience and support seamless business continuity. We'll cover key aspects of disaster recovery and demonstrate how Snowflake addresses potential data failure scenarios. 🌟 The demonstration will include: ➡ Replication Processes: Understand how data is replicated across accounts to ensure availability. ➡ Sample Account Failover: See how Snowflake handles a failover process in real-time. ➡ Sample connected application and its behaviors during DR events. Sanjay will also discuss strategies for automating the detection of disaster recovery events, as well as the steps involved in the failover and failback processes. ❓ The session will conclude with an interactive Q&A segment, allowing you to engage directly with Snowflake experts and gain insights into best practices and operational efficiencies for disaster recovery. 🚀 Come be a part of an amazing community -- Dallas is one of the local Texas user groups that is growing fast (there are also groups in Austin and Houston!). Everyone is welcome at our in-person Snowflake events, whether you're new to Snowflake or a seasoned expert. 😎 See you soon in Carrollton at the Dallas Makerspace! #datacloud #datasuperhero #snowflakesquad #disasterrecovery

34

4 Comments

#ApacheHudi is designed as a specialized storage layer, offering advanced features like indexing, change streams, incremental queries, and log merges to power incremental data processing. In this #InfoQ video, Saketh Chintapalli & Bhavani Sudha Saktheeswaran share real-world experiences gained from operating #Uber’s critical data warehousing pipelines on the new incremental model leveraging Apache Hudi, along with results from the OSS community. 👀 Watch now: https://bit.ly/4dTSRe7 #transcript included #DataEngineering #BigData #DataWarehousing #IncrementalProcessing

14

1 Comment

Wanna learn something & challenge yourself with Databricks & #GenAI this fall? Join the challenge - https://lnkd.in/g2zFFve2 🌟🌟🌟 🌍 🏆🏆🏆 #Databricks #GenAI #CloudDataPlatform #AWS #Canada #USA

18

1 Comment

JINDALSTEL: How to derive targets using Diametric pattern and Ichimoku cloud See how we derived this trend for JINDALSTEL using these powerful indicators https://lnkd.in/dsiV5Ncz

3