Saurabh Banerjee

A few months ago, Gartner shared the top 10 strategic technology trends for 2024, and one of top ones was Platform Engineering. But what is platform engineering? How does it help larger teams enhance productivity, ensure consistency and utilize resources efficiently. Read more about it in my blog - What is Platform Engineering? Link - https://lnkd.in/dFn-mCn6 Achyuta Ghosh nasscom insights Sneha Sharma #blog #platformengineering #technologytrends

21

2 Comments

Knowledge Graphs (KGs) are positioned at the center of Gartner's 2024 Impact Radar as a critical enabler for emerging technologies. They enhance data discovery, classification, and organization, improving the effectiveness of GenAI tools like Large Language Models (LLMs). KGs help enterprises connect and contextualize vast amounts of data, enabling more accurate insights and decision-making processes. This technology is particularly valuable for improving AI accuracy, supporting knowledge-intensive workflows, and increasing the explainability of AI models. Bottom Line is: You can't do AI without an ingestion engine, AKA the Knowledge Graph. KGs prime your data, ensuring it is clean, deduped and accurate. This is the necessary precursor to employing any ML modeling or creating any algorithms designed to generate useful outputs and actionable insights from your data. #knowledgegraphs #graphdatabases #AI #ML #LLMs #dataunification #EquitusAI #EquitusEnterprise

3

2 Comments

Excited to announce that I will be presenting a session on "The Magic of the Pre-Trained Transformer" at the upcoming Databricks Data and AI conference. Generative Pre-Trained Transformers (GPT), which underpin advanced GenAI technologies such as ChatGPT, are predominantly recognized for their 'Generative' functions. The current industry landscape emphasizes generative applications like chatbots and Retrieval-Augmented Generation (RAG) systems for tasks such as question-answering and summarization. However, this focus often neglects the significant potential of the 'pre-trained' transformer component, which is essential for numerous high-value applications that are currently underexplored. This session will examine the 'pre-trained' aspects of transformers and their application in various contexts. We will present a structured methodology for identifying and leveraging these use cases, categorize the types of applications that benefit from pre-trained models, and provide a practical demonstration to illustrate these principles. Additionally, you will see a demo of a Task Automation tool using external API calls and an innovative framework for systematic optimization. (hint: Matei's Stanford lab ). Participants will gain insights into the underutilized potential of pre-trained transformers and learn strategies to apply these capabilities for substantial business and technological advancements. Looking forward to seeing you there!

31

4 Comments

****** Power of the Pre-Trained Transformer ****** Join me as I dive into the bleeding-edge world of Generative AI and demonstrate how we are transforming enterprise-level tasks into efficient, GenAI-driven workflows. My session will showcase our latest innovations, including Agentic Workflows and Compound AI Systems, all designed to empower business users with the power of GenAI. We at Lovelytics are making significant headway in solving higher-order business problems, involving reasoning, actions, decisions, and tool use, all while firmly keeping the human in the loop and in control. Incorporating insights from pioneering (and sometimes controversial) research such as: "Sparks of Artificial General Intelligence: Early experiments with GPT-4" by Microsoft Research "Generative AI at Work" by Erik Brynjolfsson, Danielle Li & Lindsey R. Raymond "Chain-of-Thought Prompting Elicits Reasoning in Large Language Models" by Google Research "GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models" by OpenAI I'll be demoing a real-world workflow optimization scenario that puts these advanced technologies directly into the hands of business professionals. Join me for the session and stop by our booth (#131) to meet the team. #GenerativeAI #Lovelytics #DAIS

1

"The great thing about the Hype Cycle is that when we place something on the peak, where GenAI was last year, then there's always going to be a move down towards the trough” shares Gartner expert Afraz Jaffri. Find out what’s next for GenAI in our podcast 🎧 https://gtnr.it/4cJw3ww #GenerativeAI #GenAI #HypeCycle #ArtificialIntelligence #Podcast

1

Ever wondered about Data Factory deployments using Infrastructure as Code (IaC) and where to draw the line on where to stop coding infrastructure inside your Factory? You shouldn’t build pipelines for example using IaC, rather it should be part of development code, not infrastructure code. See my blog about it here https://lnkd.in/ejnGDUji

4

Explore how Snowflake Cortex's Classification ML function empowers financial services to tackle account churn and enhance customer segmentation effectively. 🔄 Learn more about leveraging data-driven insights to stay competitive: https://lnkd.in/dh67rWDN #Snowflake #KipiIndustryWeek #FinancialSolutions #Snowflake #Kipi #snowflake_advocate #datasuperhero #RajivGuptaEverydayLearning #SnowflakeDataSuperhero

3

As per Gartner Report, the Global Cloud Spend is expected to surpass $675 billion by end of 2024 & also around one third of this spend is being wasted due to various reasons. Cloud FinOps is the solution to navigate the Cloud Costs & align cloud spend with the value generated for the enterprises. #Heeddata #FinOps

3

🚀 New Podcast Alert: Tune in to my latest conversation with Hindol Basu on understanding the Data/Analytics/AI Ecosystem! Wizergos

26

2 Comments

"Undisciplined use of Kafka leads to poor quality data." That’s 100% true - not just for Kafka but for any data movement/integration tool. Hear hear Andrew Jones Almost everywhere I go I see a mixture of home-grown CDC, SaaS tools like Fivetran, Stitch, QlikReplicate, sprinkled with cloud tools and OSS like Airbyte and Airflow or whatever to orchestrate. The problem is very rarely the tools used. The problems always stem from a mix-and-match approach. No real holistic design … as Andrew says it is a problem of discipline. I’d go as far as say beware of any tool that makes your job of moving data easy. There will always be a catch, probably technical debt to pay down as the ELT pipelines proliferate! Paraphrasing Tolstoy “all happy data pipelines are alike, all unhappy data pipelines are unhappy in their own way”

3

2 Comments

This is a must read Forbes article by Gary Drenik which highlights on Data Quality For Good AI Outcomes. The piece talks about common data quality challenges faced by enterprises and features insights from Srinivas Atreya, Consulting Data Scientist at Cigniti Technologies. https://lnkd.in/gQ5QZwJY #ai #dataquality

3

Last week, Codex's very own Manjusha Bhakta released an invaluable resource; the Data Governance Playbook: Data Governance on a Limited Budget. In today’s landscape, many organisations struggle to secure the necessary funds to implement robust data governance. This playbook is a game-changer, offering practical insights on how to establish essential data governance practices even with constrained resources. If your organisation is facing similar challenges, this guide is a must-read. Website 🔗:

12

A good read on Hallucination Detection Methods in RAG

8

Serverless task for Python, Java, and Scala UDF/Stored Procs in #Snowflake Preview https://lnkd.in/gEtcQ5t9 #datalake #snowflake #newfeatures

7

Following up on my post from earlier this week - A video which demonstrates how the Curiosity Outer Loop Platform can be used to provide complete data coverage with the use of visual models. #OuterLoop #CuriositySoftware #TestDataManagement #TDM

11

Migrating from one system to another is difficult. Change management headache. Data migration headache. EBITDA headache. Feature-loss headache. As someone who's built+replaced custom systems in the past - my (more seasoned) advice is - don't go down that migration path. Make what you've got work for you. It'll save the headaches! #legacysoftware #systemmigration #fractionalcfo

7

Here is the latest blog on Integrating SAS Intelligent Decisioning and LLMs for Real-Time Analytical Decision-Making: Phishing detection. #generativeai #genaiusecases Happy learning, Dr.DD

28

4 Comments