Thibault Doutre

Are LLMs better reward models? Recent alignment research has seen the convergence of two approaches: reward modeling and LLM-based evaluation. Traditional reward models, used for Reinforcement Learning from Human Feedback (RLHF), are being augmented with LLMs' reasoning and critique abilities to provide more nuanced evaluations. Henry Broomfield writes about key developments in the literature: from early experiments with Reinforcement Learning from AI Feedback (RLAIF) to the latest model architectures that can generate their own critiques during evaluation. While open questions remain, we’re excited to see how these developments influence how we train and align the next generation of language models. Here’s the full article: https://lnkd.in/ewmQ8FYy

24

Last night I had the fortune of representing LaunchDarkly at Sourcegraph's CodeAI Summit NYC. An important theme I took from last night's event? Context. Models like specifics. Computers can't read our brains or know what we want to achieve. Technology is kinda useless without the right context. As we move forward in this increasingly AI-generated world (for better and for worse) let us not forget the importance of adding context to the equation. Whether that's providing context to a dataset through how it was collected, sharing context of your repo to better aid a code assist tool, or simply providing context behind the why of our decisions. It's an interesting (and important) place to keep in our minds. #AI #MachineLearning #DeveloperAdvocacy #DeveloperEvents

14

1 Comment

👋 Today myself, Benji Vaughan and Mark Downey (with more names coming soon) set out on a new journey. I'm thrilled introduce Conduit AI (conduit-ai.com), a new company on a mission to empower SMEs with the incredible potential of generative AI, especially retrieval augmented generation (RAG) applications. But first, let's briefly explain what RAG is and why it's a game-changer for businesses. RAG is a powerful AI technique that combines the knowledge stored in large language models (LLMs) with the ability to retrieve and incorporate relevant information from your own data sources. This means RAG-powered applications can generate highly accurate, context-aware, and up-to-date responses to a wide range of queries. For SMEs, this translates to unparalleled productivity gains, enhanced customer experiences, and a significant competitive edge. 🚀 Now, a bit about our journey. Starting Conduit AI has been an exhilarating leap of faith, fuelled by our passion for AI and the unwavering support of our loved ones and mentors. We couldn't have done it without their wisdom and encouragement. 🙏 Over the past year, we've been on a mission to deeply understand how SMEs can effectively adopt generative AI. We've collaborated with companies across various industries and consistently found: SMEs are excited about the potential of LLMs to boost their productivity and profitability. 📈 There's a strong interest in RAG applications that can generate valuable insights from both unstructured and structured data. 💡 Many SMEs are concerned about developing LLMs in-house due to expertise gaps, reliability, trust, and privacy issues. 🔒 We've learned that SMEs are eager to become AI-enabled but need a trusted partner to help them develop a long-term AI vision and deliver products that bring this vision to life. That's where we come in! 🤝 At Conduit AI, our goal is to be the channel that helps SMEs transition into an AI-enabled world. We'll work closely with you to: - Develop a tailored AI strategy 🎯 - Design an adoption roadmap 🗺️ - Identify and implement low-risk, high-return AI applications 💪 With our team's 15 years of ML/AI/NLP experience, having built AI/ML tools for companies like Zurich Insurance and OVO, we're well-equipped to create AI strategies and applications that are tailored to your unique vision, team, and culture. 🌟 We can't wait to share more about our growing team and the incredible stories of the clients we'll be working with. If you're curious about how AI can transform your business, let's chat! 💬 Thanks for being a part of our exciting journey! 🙌 #AIConsulting #TechStartup #SMEs #FutureOfWork #RAG #newventure

45

9 Comments

This is f*cking hilarious: TuSimple's pivot from self-driving trucks to AI animation and gaming! 🤖🎮 Right now, everyone’s betting on humanoid and general-purpose robotics startups. But after 5 years in self-driving tech and building Kopernikus Auto, here’s the reality: most humanoid robotics companies will be dead. In the self-driving world, we’ve only seen a few real winners: Tesla, Waymo, and Comma.ai. Why?  - Humanoid robotics isn’t a hardware problem; it’s a software problem. - You either have infinite data, cash, talent, or a clear use case—or you won’t make it, no matter how much you raise. From over 100 companies, almost all in self-driving tech are dead or miles away from profitability. ✨ Don’t get distracted by the appeal of humanoids. Focus on real problems you can actually solve. What are you focusing on? 👇

13

1 Comment