PyCon DE & PyData’s Post

⭐️ New video release 📺: RAG for a medical company: the technical and product challenges Watch Noé Achache discuss the technical and product challenges of building a performant #RAG for a medical company, focusing on leveraging #LLMs and enhancing retrieval and generation metrics to bring value to users in the health sector. 📺 Watch the video on YouTube: https://lnkd.in/eb4xXUWk @Noé Achache, the GenAI leader and Lead Data Scientist at Theodo Data & AI (ex-SICARA), shared insights on the technical and product challenges faced while developing a Retrieval Augmented Generation (RAG) system for a medical company. The talk highlighted the complexities of leveraging tools like Chainlit, Qdrant, and Langsmith to enable doctors to query drug documentation with natural language. The discussion focused on enhancing retrieval and generation metrics through the strategic use of Large Language Models (LLMs), despite the inherent limitations of accuracy in the healthcare sector. By incorporating sources directly into generated answers and utilizing tools like Langsmith for logging and dataset augmentation, the team ensured user trust and interaction correctness. The session underscored the importance of technical improvements and product design to create a performant RAG that delivers value to users while addressing challenges unique to the medical domain.

To view or add a comment, sign in

Explore topics