Catarina Moreira’s Post

View profile for Catarina Moreira, graphic

Associate Professor in Machine Learning | UNESCO Co-Chair on AI and XR

🎉 Thrilled to share our latest publication in Machine Learning and Knowledge Extraction (Impact Factor: 3.9) titled "EyeXNet: Enhancing Abnormality Detection and Diagnosis via Eye-Tracking and X-ray Fusion"! 🎉 🔗 Paper: https://lnkd.in/dsec2FRG 👩💻 Code: https://lnkd.in/dtwgNjx5 In our study, we analyzed think-aloud protocols where radiologists not only viewed the images but also verbalized their observations. We also developed EyeXNet, a deep-learning framework that integrates radiologists' fixation masks with chest X-ray images for improved abnormality detection. Our study shows: 🎯 Exploration Dominance Initially: At the onset of image examination, radiologists predominantly engage in exploratory gaze patterns, scanning broadly to gather visual information. 🎯 Targeted Gazes When Reporting: Once they begin to articulate their findings, their gazes become more focused, honing in on specific areas of interest likely indicative of abnormalities. 🎯 To harness these insights, we filtered out the gaze data from silent moments, focusing solely on the periods when radiologists reported their observations. 🎯 Enhanced Prediction Accuracy: Demonstrated that using fixation maps during radiologist reporting moments leads to higher precision and recall in detecting abnormalities compared to baseline models. This paper is the result of André Luís's master thesis, which was further developed by Chihcheng Hsieh with the support of José Neves, Isabel Blanco Nobre, Sandra Costa Sousa, Chun Ouyang, Joaquim Jorge, and myself. Congratulations on this fantastic achievement! #MachineLearning #DeepLearning #MedicalImaging #EyeTracking #AIResearch #HealthcareInnovation

  • diagram
André Luís

Data Analyst at Tripadvisor

7mo

This is great, congrats! Glad to have had the chance to work with you all

Joaquim Jorge

UNESCO Chair on AI & XR | Eurographics & IEEE Fellow

7mo

congratulations to all co-authors

Lachlan Fowler

Data Analyst with a passion for transforming complex data into actionable insights, seeking new opportunities to drive informed decision-making and strategic growth.

7mo

Great work this use of image recognition conv neural nets is interesting and life changing.

Dr. Shamila Nadir

Bridging Science, Creativity, and Business | Co-Founder at HokusPokus.ai

7mo

Congratulations! Great advancement in the use of AI towards Healthcare Innovation.

Beck Nadir

Empowering Business Growth with AI and Training | Founder/CTO at HokusPokus AI | Ex-Nuclear Engineer

7mo

Amazing! Congratulations!

See more comments

To view or add a comment, sign in

Explore topics