Laboratory for Computational Social Systems (LCS2)’s Post

We are thrilled to announce that our recent work on evaluating state-of-the-art LLMs for summarizing components of mental health therapy sessions has been published in JMIR Mental Health! ✨ In this study, we develop a benchmarking dataset focused on counselling aspects and evaluated eleven SOTA LLMs on aspect-based summarization. We report the performance of these models on various parameters, including affective attitude, burden, ethicality, coherence, opportunity costs, and perceived effectiveness. This project was a major collaborative effort with AIIMS Delhi, AIIMS Rishikesh, and YourDOST. Kudos to Prottay Kumar Adhikary, Aseem Srivastava, Dr. Shivani Kumar, Dr. Michael Salam, Puneet Manuja, Dr. Jini K Gopinath, Dr. Vijay Krishnan, Dr Swati Kedia Gupta, Dr. Koushik Sinha Deb and Dr. Tanmoy Chakraborty for their incredible contributions! 🔗 Read the full text: https://lnkd.in/g_Tm3Te6 Indian Institute of Technology, Delhi RnD IIT Delhi Indraprastha Institute of Information Technology, Delhi AIIMS (All India Institute of Medical Sciences, New Delhi) ALL INDIA INSTITUTE OF MEDICAL SCIENCES, RISHIKESH Yardi School of Artificial Intelligence YourDOST #MentalHealth #LLMs #AIResearch #Collaboration #ResearchPublication #MentalHealthResearch #TherapySummarization #BenchmarkingDataset #AIEthics #AffectiveComputing #AIforHealthcare #JMIR JMIR Publications

  • No alternative text description for this image
Vasundhra D.

Doctoral Candidate • Sociotechnical Researcher, AI Therapy Chatbots • Critical AI • AI Governance • Algorithmic Accountability • HASTAC fellow 22-24 • Co-founder CLAIM reading group

4mo

This seems exciting! I'm doing a study over the social aspects of LLMs used for therapy in India. I'd love to interview the scholars and professionals on board. Thanks!

Sarthak Jain

Signal Processing/NLP @Sony @UofSC AIISC | AI/ML @IIITD

4mo
Like
Reply
See more comments

To view or add a comment, sign in

Explore topics