🎉 Thrilled to share our latest publication in Machine Learning and Knowledge Extraction (Impact Factor: 3.9) titled "EyeXNet: Enhancing Abnormality Detection and Diagnosis via Eye-Tracking and X-ray Fusion"! 🎉 🔗 Paper: https://lnkd.in/dsec2FRG 👩💻 Code: https://lnkd.in/dtwgNjx5 In our study, we analyzed think-aloud protocols where radiologists not only viewed the images but also verbalized their observations. We also developed EyeXNet, a deep-learning framework that integrates radiologists' fixation masks with chest X-ray images for improved abnormality detection. Our study shows: 🎯 Exploration Dominance Initially: At the onset of image examination, radiologists predominantly engage in exploratory gaze patterns, scanning broadly to gather visual information. 🎯 Targeted Gazes When Reporting: Once they begin to articulate their findings, their gazes become more focused, honing in on specific areas of interest likely indicative of abnormalities. 🎯 To harness these insights, we filtered out the gaze data from silent moments, focusing solely on the periods when radiologists reported their observations. 🎯 Enhanced Prediction Accuracy: Demonstrated that using fixation maps during radiologist reporting moments leads to higher precision and recall in detecting abnormalities compared to baseline models. This paper is the result of André Luís's master thesis, which was further developed by Chihcheng Hsieh with the support of José Neves, Isabel Blanco Nobre, Sandra Costa Sousa, Chun Ouyang, Joaquim Jorge, and myself. Congratulations on this fantastic achievement! #MachineLearning #DeepLearning #MedicalImaging #EyeTracking #AIResearch #HealthcareInnovation
congratulations to all co-authors
Great work this use of image recognition conv neural nets is interesting and life changing.
Congratulations! Great advancement in the use of AI towards Healthcare Innovation.
Amazing! Congratulations!
Data Analyst at Tripadvisor
7moThis is great, congrats! Glad to have had the chance to work with you all