Gayathri Subramanian

Thats the exact explanation I gave to a group of investors last week. (… it’s just Precision/Recall, attributes vectorization as “embedding”, K-Nearest Neighbor, User Search Intent, DAG, ML algorithms, etc all over again …). LOL and they asked what’s new this time around. And I was like not much, ML is still the backbone, and AI is the inference and actions based on the model. It works better when there is a feedback loop in a closed system. But the current state of the art like ChatGPT is based on scraping the Internet (garbage in, garbage out). Kinda like early search engines. What is a better analogy is that NVIDIA/Snowflake etc are selling tools, aka pickaxes to prospectors. The gold is up to you to find. And the opportunity right now is to monetize industry specific (healthcare, travel, financial services) clean data to build models with (aka a treasure map for the prospectors). From an enterprise perspective, what’s out there today aka generative AI isn’t very useful. Too much hype. To build useful engines will require an effort similar to search revolution 2 decades ago. From

16

3 Comments

I am excited to share the latest blog, co-authored by myself, Junhwi Kim and Vyas Sekar, detailing how we managed to successfully localized and improved LLM by combining Fine-Tuning and RAG. https://lnkd.in/gKDkgGPq

70

3 Comments

Recently, I had an intriguing task: I saw my wife enter our daughter's play rehearsal schedule in the calendar manually. I decided to see if I could use LLMs to take events from a detailed rehearsal schedule in PDF format and extract calendar events for my daughter’s rehearsals. This was more than a simple extraction - it had to be personalized - it required understanding nuanced details like recognizing that “full cast” events should include her (LLMs initially missed that), roles she was playing, conflicts etc. I tested several AI tools, including GPT-4o, Gemini, and Claude 3.5 Sonnet. While the initial data extraction had its hiccups (it took multiple passes to get all the events) - I was a bit surprised by that, the real magic came in what these tools could do once the data was extracted: • I got close to 40 events for 2 weeks, then I asked the events on the same day to be grouped together. It was very impressive - it not only grouped but embedded the event details that were grouped into the description. • Renaming the events to improve clarity and context was just a simple prompt. • Finally automatically generating an .ics file with ready-to-import calendar events. This process highlighted how AI’s strength often isn’t just in extracting data but in post-processing it into actionable, user-friendly outputs. In this experiment Claude 3.5 Sonnet performed the best. The key insight? AI tools require thoughtful guidance and iteration, especially when personalizing outcomes - this needs domain expertise. As a tech leader, this reinforced the importance of adaptability—not just evaluating tools for accuracy but leveraging their transformative potential. What are some of your favorite use cases for AI in streamlining everyday workflows? #AI #Productivity #Leadership #TechInnovation

93

14 Comments

Our Kumo.AI blog post on Hybrid GNNs is out. https://lnkd.in/gpzr8TiF We have seen success with our Hybrid GNNs across several marketplace problems. Hybrid GNNs are a novel innovation at Kumo.AI because they model both repeated and explorative user interactions within a single GNN framework. The GNN automatically infers whether a user tends to do repeat purchases or tends to be more exploratory (ie buying new unseen items) and learns a repetition scalar per user. What we love about this approach is that it takes away from the standard recommendation systems architecture where you have multiple candidate generators - some for new unseen items, some for repeat behavior and then have to combine them in a final multi-objective optimization framework. Such systems which are a combination of multiple systems are hard to maintain, re-train and operationalize. On the Kaggle H&M challenge where most winning teams usually have approaches that require large amounts of feature engineering and the final system is a complex ensemble of approaches needing months to build, the Kumo.AI approach which is a 3 line predictive query that runs a Hybrid GNN under the hood is top 1%. Thanks Matthias Fey and Weihua Hu for the algorithms and innovation.

158

2 Comments

Large Language Models (#LLMs) are evolving rapidly, and the demand for running them at scale is skyrocketing. #Ollama is stepping up to meet this need with its official container image on Docker Hub, excelling in local #deployments. However, there’s a catch for containerized environments: downloading #models requires the ollama serve command to be running within the #container. This extra step complicates automated deployments via #CI #CD #pipelines, making seamless model access challenging. To take your #model to production, it needs to be #container-ready—a feature Ollama has yet to fully support. The gap in #AIOps for smooth deployments gets blurred with the inference services available as an easy way to take it to production. Goal is to overcome obstacles and deliver solutions 😉 so here is to get you started on having your (O)#llama #production ready in a private #deployment from your #local to #cloud all in #oneshot . Enjoy Medium: https://lnkd.in/g9jqBQ8d dev.to: https://lnkd.in/gi_gGwam #AI #LLM #Ollama #llama3 #phi3 #mistral #S6overlay #AIOps #CI #CD #oneshot #container #docker #podmanEnjoy

11

Graviton is a super efficient (and green) way to manage a lot of the heavy lifting around GenAI and AI/ML... both in prepping the training data and doing the inference.

15

Is Gen AI hype or real? Hosting a panel of experts from Amazon ( Thank you- Muthu Muthukrishnan, Jeetu Mirchandani, Mukesh Karki, Anand Rathi) in AWS Fintech summit to talk about building enterprise Gen AI solutions and applying Gen AI at scale was an honor. We discussed potential, technological challenges, including hallucinations and accuracy, cost, and go-to-market plans for AWS, Advertising, Stores, and the AGI space. #GenAI #ArtificialIntelligence #AWS #FintechSummit

205

5 Comments

🏁 Bay Area vs. Los Angeles rivalry Exactly 3 years ago we moved to the Bay Area from LA, where I spent most of my life. Since then many have asked me what I feel the differences are. My general breakdown: 👩🏽‍💻 Technology Bay Area > LA - There is no place like the Bay for the sheer quantity and quality of big tech companies, startups, VCs, academic institutions, and talent. LA has Silicon Beach, which focuses mostly on media, entertainment, and consumer tech, while the Bay ecosystem is more diverse and dense. Some claim Silicon Valley has lost its appeal, I’d say the deep-rooted technology ecosystem, going back nearly a century with Bell Labs, HP, Shockley, etc., is not easily replicable. 🌴 Lifestyle Bay Area > LA - As my neighbor accurately put it: “In LA, success is measured by name-brand bags, luxury cars, and big houses. In the Bay, it's by how many exits you've had and the number of boards you're on." Both are ego driven, but I’d take the latter. LA > Bay Area - The cost of living in the Bay is infamously insane. (Cost of living in San Francisco is 23% higher than the state average and 71% higher than the national average. Housing is 187% more expensive than the U.S. average, while utilities are about 42% pricier.) LA > Bay Area - LA takes the crown for its diverse food scene, great restaurants, and affordability. Especially with Asian cuisine, it's hard to compete with the options in the San Gabriel Valley. LA > Bay Area - Style and cultural diversity are stronger in LA. Even though I ❤️ close to 30% of population in the Bay are AAPIs LA > Bay Area - grew up in Purple & Gold Bay Area > LA - Traffic, obvious Bay Area = LA - Weather, which is why we pay the infamous California "weather tax" 👥 People Bay Area > LA - Bay Areafolks are generally much nicer and more courteous than Angelenos. Bay Area > LA - The Bay has the most passionate people I've met when it comes to community involvement, activism, and social/political issues. Ingrained in the DNA and its cultural history. Which city is better? 🤼 “Let me serenade the streets of L.A. From Oakland to Sac-town, the Bay Area and back down Cali is where they put they mack down, give me love!” - Tupac

55

22 Comments

📣 We are excited to have AasaanWill be a part of the Growth Spin Accelerator in partnership with Google Cloud! 🤯 97% of Indians do not have a Will in place because the current system is tedious, time taking, opaque and expensive. Close to $100 Billion of wealth lies unclaimed in India because succession planning is not accessible to most Indians. Currently, it takes an average of 600 active minutes and interaction with at least 5 different stakeholders to get your Will drafted and registered in India. 🤖 AasaanWill aasaanwill.com is making succession planning easy and affordable by incorporating technology into the whole value chain effectively bringing down the required time to get a Will from 600 active minutes to 90 minutes. AasaanWill, allows Indians across the world to create a legally valid Will in 3 easy steps. They save money and time. Get to know the minds behind AasaanWill Vishnu Chundi, CEO, Founder - BITS-Pilani, University of Cambridge, London Business School Alum. He has worked with BCG and was the product head at Wonga. Brings 15 years of experience of entrepreneurship, strategy and building companies including Assetvault. Abhinav Daga, CoS -  BITS Pilani, ESSEC Business School Alum, 2X tech founder, 10+ years of experience as a Product Manager, Consultant, Marketer across India, Europe, Middle East and South East Asia. Monika Taparia - Head of Legal, an advocate with over 10 years of experience in Succession Planning and IP. 💼 About Growth Spin Accelerator in partnership with Google Cloud We have hand-picked pre-Series A startups who are disrupting industries and literally changing the world. Join us for the demo day at the Google office on 30th October. DM me for details. 🔍 About Growth Spin: We are a full-funnel growth studio specializing in marketing and product helping fast growth companies. To learn more about how we can help your business grow, visit our website - growthspin.co.uk Pablo Terpolilli, Bruno Bossola, Roohi Hamlani, Charles Leclercq, Cristian G., Alexandru Luncashu, Ping-Lin Chang, Vishnu Chundi, Vytautas S., Terence Reilly, Sebastian Haire #GrowthSpinAccelerator #GoogleCloud #entrepreneurship #googlecloudpartners

16

Istio Service Mesh: great to see Ambient moving up to Beta, delta xDS becoming the default, and api-gateway becoming a first class citizen in Istio. https://lnkd.in/gYPmnTuj

34

Signal boosting this post from my colleague Arun Shankar. My snarky summary "It's like caching, but semantic" :P Oddly, I think it's a reasonable summary... semantically similar inputs hit the same cache, otherwise dissimilar input miss.... ... but how do you do that on non-exact matches and how to you manage such a system? I guess you'll have to read: https://lnkd.in/gPgtM8T5

13

1 Comment

AI Appreciation Day is here and I am thrilled to share the excitement it brings us as we reflect on the transformative impact AI has on our daily lives and work. AI for us, is not just a buzzword—it's the heartbeat of innovation, driving us to new heights and redefining possibilities. At Smytten Pulse, we leverage AI to understand our consumers better, personalize experiences, and deliver insights that fuel informed decisions. What excites me most about AI is its ability to learn and evolve. It’s like having a team member that never stops growing! With every interaction and data point, our AI systems become smarter, more intuitive, and more aligned with our goals. This dynamic capability empowers us to stay ahead of trends and continuously improve our offerings. 🚀 One of the most rewarding aspects of my role is witnessing the synergy between our talented engineers and AI. The collaboration fosters creativity, problem-solving, and a relentless pursuit of excellence. Together, we are not just building technology; we are shaping the future. On this AI Appreciation Day, I want to extend my gratitude to our team at Smytten Pulse and the incredible AI community. Let’s continue to push boundaries, embrace challenges, and unlock the full potential of AI. Here’s to a future where AI and human ingenuity go hand in hand! 🙌 https://pulse.smytten.com/ Smytten Pulse #AIAppreciationDay #AIInnovation #EngineeringExcellence #SmyttenPulse #FutureForward

126

𝗟𝗲𝘀𝘀𝗼𝗻𝘀 𝗳𝗿𝗼𝗺 𝗦𝘁𝗲𝘃𝗲 𝗝𝗼𝗯𝘀: 𝗧𝗵𝗲 𝗣𝗼𝘄𝗲𝗿 𝗼𝗳 𝗗𝗲𝘁𝗮𝗶𝗹𝘀 𝗮𝗻𝗱 𝗜𝗻𝘁𝗲𝗴𝗿𝗮𝘁𝗲𝗱 𝗘𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲𝘀  The 𝘚𝘵𝘦𝘷𝘦 𝘑𝘰𝘣𝘴 biography by Walter Isaacson highlights how transformative a dedication to detail can be in building iconic products. Jobs was relentless about the small things – the often-overlooked details he believed were essential to a product’s soul. Take, for instance, his insistence on a slot-loading CD/DVD drive for the iMac instead of the traditional tray. For Jobs, this wasn’t just an aesthetic choice but a statement of simplicity and elegance. He felt users would sense this refinement, even unconsciously. It’s a reminder that what might seem minor can ultimately shape a product’s perception and feel. This meticulous attention extended across everything Apple created. Jobs was known to care about typefaces, button layouts, and even the arrangement of circuit boards inside devices, setting a standard that every touchpoint should be crafted with care and intention. In software, he pushed for fluid animations and subtle sounds that felt intuitive, creating harmony between user and product. But his focus wasn’t only on the details – he believed in building fully integrated experiences. Apple’s software ecosystem is a perfect example. Consider how iMessage, FaceTime, and AirDrop work seamlessly across devices. This seamless integration wasn’t accidental; it was a result of careful planning where every piece was designed to complement the others, allowing users to switch effortlessly between devices. Another example is iCloud, which connects photos, documents, and apps across devices in real-time, giving users a sense of continuity and connection. For software and digital products, these principles are powerful. Imagine creating an experience that doesn’t just optimize each part but feels unified end-to-end. Integrating design and functionality seamlessly – from backend processes to front-end interfaces and customer support – can turn a functional product into a memorable one. And paying close attention to the details, like smooth transitions or well-paced loading speeds, often makes the difference between a good experience and a great one. Jobs’ approach reminds us that a product’s magic often lies in the fine details and the effort to build an experience that feels complete, connected, and crafted with intention. #ProductDesign #CraftingExperiences #LeadershipLessons

4

2 Comments

📣 Massive kudos to our Google Cloud team for their show-stopping demo at Google I/O! 🚀 Rajesh Thallam and Skander Hannachi blew us away with their Google I/O demo, revealing the seamless integration of open-source models like #TimesFM from Google with Vertex AI and Gemini. This groundbreaking approach empowers developers to augment generative AI applications with predictive capabilities, opening up a world of possibilities for smarter, more efficient solutions across industries. 📈 The secret sauce behind this innovation is a potent combination of cutting-edge technologies: - #TimesFM: An open-source model from Google, designed specifically for time series forecasting. - #Vertex AI: Google Cloud's machine learning platform, providing the infrastructure and tools to train, deploy, and manage AI models. - #Gemini: Google's family of powerful foundation models, enabling advanced AI capabilities. This demo is just a glimpse of what's possible when we combine the power of open-source models with the scalability and flexibility of the Google Cloud. It's a testament to the incredible work being done by both our Cloud team and Google Research. 👏 #GoogleCloud #VertexAI #Gemini #HuggingFace #TimesFM #GoogleIO

107

2 Comments

Kapil Khangaonkar, CEO of Clodura.AI, shares how Google Cloud fueled their growth: 71% less tech debt, 12x faster app delivery, & significant customer growth. 🚀 Ready to transform your startup? The Google for Startups Cloud Program now offers new benefits for AI startups, giving you the technology and resources to build easily. Take advantage of our open AI ecosystem and tap into the best of Google’s infrastructure, AI products, and foundation models.   Sign up today and unlock your startup's potential! #startups #cloud #GoogleCloud #CloduraAI #techstartup #startuplife #AI #buildwithAI #GoogleAI #GoogleforStartups #GoogleCloudforStartups https://goo.gle/GFSCP_CS Clodura.AI Google for Startups

2

🍜Anybody up for some ramen? I am excited to share that I am back in the garage, building again (it’s actually a house in the Berkeley Hills). We are taking the wraps off of Supercog AI, a new startup focused on solving Application Integration using LLM powered agents. My co-founder in this new venture is a great friend of mine (and a former co-founder partner), Alex Osborne. Alex and I have worked around the application integration space for a long time, and we are unrealistically excited about applying the GenAI stack to this problem. Not many people relish the task to get some bits to move from system A to system B. But it’s a critical job to be done, and that’s led to a lot of brittle scripts, a myriad of inflexible “no code” tools, and a lot of hand crafted SQL. But the power of the Large Language Model, trained on a huge corpus of information, offers a remarkable tool to solve this problem. The LLM you use today already knows the APIs of hundreds of popular systems. It knows the SQL dialects of every major database. It understands the semantics and data schemas of many popular SaaS systems. It understands much of the specific domain in which your business operates. I like to call the AI revolution “the last platform shift”. That may turn out to be hyperbole, but I definitely believe we are in the very early stages of seeing what this new stack can enable. I know we are hardly the first folks to claim that “amazing stuff is coming!”. But this is why Alex and I have decided to focus on a real and hard problem. If we can prove that LLMs can power a new way to solve this problem, it will be the first successful *new* approach in 15 years.. We will have much more to share about this new platform soon. In the meantime, if you’re interested in getting a peek - or even better if you have application or data integration tasks that you would like some help with - please reach out because we want to help. #genai #startups #backinthegarage

163

37 Comments