Dominik Kundel

As academic based LLM benchmarks are losing their relevance -- there are 2 types of Benchmarks that will matter more in the B2B space: 👉 Crowdsourced user votes to rank LLM output (like Chatbot Arena) OR where the test DATASET is kept secret by the evaluator (e.g GSM1k from scale_AI) 👉  Enterprise use case specific LLM benchmarks (e.g produced by CRM, ITSM, HR SaaS companies) evaluated on real data. Because you can not game real customer use cases. #llm #benchmarks #llmeval #AI

11

1 Comment

ENOUGH WITH THE FRAMEWORKS! If you've worked with me, you've probably heard me say that. Product teams should be focused on driving outcome and impact, not falling in love with the process. And that's something Peter Yang from Roblox knows all too well. We had a great conversation on Next Gen Builders about how the PM role is evolving, how to use #AI to focus on more important work (like talking to customers), and more. Tune in to our conversation: https://lnkd.in/dY-AZh2s

81

5 Comments

#AI will replace #ProductManagers. That's my thought - with a caveat: It's not going to replace all Human PMs, but augment their abilities in such a way that the role of PM today will evolve into something else. Either 1 PM will do the work of 2-3 PMs today, or a PM will be a hybrid of what a PM is now + other skills. AI is what will help them do that - because you'll have much more time to focus on other (important) things. I practice what I preach: Try our AI-based toolset that gives you the power of a Virtual Product Team - cheaper than a ☕ https://lnkd.in/emaatThR

5

✨🚨 Another Make Cents post is live! 🚨✨ In this post, "AI & its Impact on Vertical SaaS: The Gates of Distribution have Flung Open", I explore how AI is impacting vertical SaaS workflows and its implication for distribution and defensibility. We defy.vc are more excited than ever to invest in vertical SaaS because we believe there's tremendous value leveraging AI to enhance human productivity across tasks like 1) structuring data, 2) analysis, 3) recommendations, and 4) taking action. I also walk through why customer acquisition costs are at an all-time low, attributed to more than just AI-driven product functionality. Read more ⬇ and share your thoughts and feedback in the comments! https://lnkd.in/gRVcJASH

46

3 Comments

Liz Fieno’s article on building better AI/ML products offers a solid blueprint for how product managers can strategically integrate AI into their workflows. What really stands out is the emphasis on contextualizing data—turning raw numbers into actionable insights, and using that knowledge to drive product innovation. One of the key takeaways for me is the iterative nature of AI development. It’s not just about implementing AI features and moving on. True success comes from constantly measuring adoption, gathering user feedback, and refining those features based on real-world usage. AI empowers product managers to step away from manual, repetitive tasks and focus on high-impact work, like identifying where automation and intelligence can streamline user experiences. The article also highlights the importance of anticipating user needs and offering proactive support for AI features. This resonates deeply, as AI adoption is only as strong as its ability to seamlessly integrate into existing workflows and provide real, personalized value to users. Ultimately, AI is reshaping the role of product managers by pushing us to think beyond traditional playbooks, and I’m excited about how we can continue to leverage these tools to drive smarter, data-driven decisions. #AI #ProductManagement #Innovation #DataDriven

6

Anthropic introduces Autonomous AI Agents that use a computer mouse and screen to perform complex tasks independently. Currently available for developers only through the Claude 3.5 Sonnet API.

7

An interesting new pattern has emerged in the last two weeks where mysterious LLMs are showing up from nowhere without any clear ownership or other details. For example, a mysterious chatbot version called "gpt2-chatbot" is outperforming GPT-4, Gemini 1.5, and Claude. You can check it here - https://chat.lmsys.org/ People are speculating this is from OpenAI.. but I expect many LLM builders are going throw mysterious model in the wild, and this is going get more confusing over time. #llm #mysteries #openai

17

1 Comment

AI memory is fundamental for conversational AI and AI agents. It is critical for building personalized experiences and improving reasoning. Check out Letta’s course to understand how to use AI memory to enhance the customization and quality of your AI app.

15

Whether to include LLM-based GenAI features in your data product is not a simple, binary question. Strong leadership is needed, and context really matters—particularly when we have this risk of reacting to incorrect information that looks plausible and believable because of how many LLMs tend to respond to prompts with a positive sheen much of the time. Learn more below. ⬆️ Join 2k readers: tap “Visit my website” to get my latest thinking in your inbox 🚫 Don’t like LinkedIn’s algo deciding what you see? Tap the bell under my profile banner to get all my posts ♻️ Please repost if this was useful 🎧: https://bit.ly/3W5IddY #LLMs #genAI #ai #ux #design

2

5 Comments

Using Generative AI for simplifying complex concepts

10

Thanks Zapier for listing Sembly AI as a top AI tool! https://lnkd.in/emA3HU8i We have had support for Zapier integrations for a while now, along with other automation methods like native integrations and custom webhooks. Happy to be recognized for the value our customers are deriving from enriching their existing application ecosystem with Sembly's AI-powered transcripts, meeting notes, tasks, and insights for CRMs, task management, knowledge bases, and more. A full listing of natively supported apps can be found here: https://lnkd.in/e4JcbFFw ...and, of course, hundreds more via Zapier's ecosystem. #automation #workflows #aitools #zapier #semblyai

22

1 Comment

When working on larger projects and / or those with high outcome uncertainty, many org cultures (surprisingly pervasive even in many startups) tend to prioritize tackling low-hanging fruit or default to taking a consensus path ironically termed "the path of least resistance". This approach of solving easy sub-problems ("known unknowns" as Donald Rumsfeld fmr. US Sect of state, would have termed it) builds in sunk costs & illusions of progress, creating inertia to course correct. Most modern project or program operations turn out to be successful if we view them as a portfolio of risks (sorted by highest impact, high uncertainty to lowest impact, high uncertainty). Tackle the ones at the top first. Prove or disprove your hypotheses. Source of image: First round review #product #bets #operating #principles

7

AI isn't just about replacing humans—it's about empowering them. 💪 AssuranceIQ, an innovative insurance startup, is pioneering a groundbreaking approach to leveraging generative AI: 1. They're using Large Language Models (LLMs) to score customer conversations. 2. This AI-powered system structures unstructured data from interactions. 3. The goal? Enhance the performance of human sales and support teams. 4. It's not about AI vs. humans, but AI amplifying human capabilities. 5. This could revolutionize how we train and develop customer-facing teams. This use case showcases the true potential of AI in business: not as a replacement, but as a powerful tool to augment human skills and drive performance. What other innovative ways could we use AI to empower rather than replace human workers? #AIInnovation #CustomerExperience #FutureOfWork #BusinessAI #TechTrends Share your thoughts on AI augmentation in the comments below!

10

1 Comment

Andrew Chen puts into words what many product people have realized in the trenches. There is more to product decision making than data. Having taste, sometimes rebranded as "product sense", is something I've been leaning into. There's usually not any meaningful data at the earliest stages anyways, it's about a developing a vision informed by your depth of experience, your conversations with customers, and your differentiated view of the world. https://t.co/ZR3HFdfDX9

16

4 Comments

This is an excellent example of how product leaders can gather feedback for new product. ⬇ Got this email from Daniel Wolchonok at Reforge. Not sure if this works for complex enterprise products, but for freemium/plg type companies - this is brilliant. 👏 #productmanagement

35

4 Comments

Learn about OpenAI's Fine-Tuning feature and create a custom chatbot! Check out this quick training Mark Shenouda and I did! https://lnkd.in/e86BYTzm

2

Learn about OpenAI's Fine-Tuning feature and create a custom chatbot! Check out this quick training Mark Shenouda and I did! https://lnkd.in/e86BYTzm

2

Learn about OpenAI's Fine-Tuning feature and create a custom chatbot! Check out this quick training Mark Shenouda and I did! https://lnkd.in/e86BYTzm

2

Looking for a Product Leadership role? Explore these top opportunities to drive innovation, lead teams, and shape strategy at these companies: 1. SVP, Product Management – MasterControl, Salt Lake City, UT (Remote) Lead product strategy and development for MasterControl's quality and compliance software portfolio while managing the product management team. MasterControl provides cloud-based quality and compliance software to over 1,000 companies in life sciences and regulated industries. 2. Group Product Manager - Microsoft Security Service Edge – Microsoft, San Francisco, CA (Remote) Lead Microsoft's Security Service Edge (SSE) offering, driving product strategy and development for Microsoft Entra Internet Access and Private Access solutions. Microsoft is a global technology leader with 228,000 employees across 190 countries, focused on empowering every person and organization to achieve more through technology. 3. VP of Product Management – Benevity, Seattle, WA Lead product strategy and development for Benevity's Finance Platform, managing a product team while driving vision, roadmap execution, and platform operations. Benevity is a B Corporation that provides social impact technology to Fortune 100 companies, enabling corporate giving, volunteering, and other social action initiatives. 4. VP of Product – Banyan Software, Chicago, IL Serve as a key executive leader at SoftSmiths (a Banyan Software portfolio company) responsible for driving product strategy, innovation, and execution in the energy sector, initially working independently with potential to build a product team. Reports to the CEO of SoftSmiths, working closely with VP Technology. Banyan Software is one of fastest-growing private software companies in the US that acquires and grows enterprise software businesses with dominant positions in niche vertical markets, operating with a permanent "buy and hold for life" strategy. 5. Director of Product Management – Mark43, New York, NY (Remote) Lead the Computer Aided Dispatch (CAD) product line and Mobile applications, managing a team of 2-3 Product Managers while driving product strategy and development. Mark43 is a technology company that develops cloud-native software solutions for law enforcement and public safety agencies to improve community safety and quality of life. 6. Head of Product – 0x, San Francisco, CA (Remote) Lead Product team overseeing consumer and developer platforms while driving product strategy and fostering team growth. Reports directly to the CEO. 0x is a Web3 company providing developer APIs for token access and liquidity, having processed over $130B in trading volume through major platforms like Coinbase and MetaMask. Want more Product Leadership roles? Access the weekly updated database: https://lnkd.in/gq9qY6s4

4