Abstract
It has been suggested that the retinal vasculature alternations are associated with dementia in recent clinical studies, and the eye examination may facilitate the early screening of dementia. Optical Coherence Tomography Angiography (OCTA) has shown its superiority in visualizing superficial vascular complex (SVC), deep vascular complex (DVC), and choriocapillaris, and it has been extensively used in clinical practice. However, the information in OCTA is far from fully mined by existing methods, which straightforwardly analyze the multiple projections of OCTA by average or concatenation. These methods do not take into account the relationship between multiple projections. Accordingly, a Multi-projection Consistency and complementarity Learning Network (MUCO-Net) is proposed in this paper to explore the diagnosis of dementia based on OCTA. Firstly, a consistency and complementarity attention (CsCp) module is developed to understand the complex relationships among various projections. Then, a cross-view fusion (CVF) module is introduced to combine the multi-scale features from the CsCp. In addition, the number of input flows of the proposed modules is flexible to boost the interactions across the features from different projections. In the experiment, MUCO-Net is implemented on two OCTA datasets to screen for dementia and diagnose fundus diseases. The effectiveness of MUCO-Net is demonstrated by its superior performance to state-of-the-art methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
We will make our code available after our paper is accepted https://github.com/Wangxingyue98/MUCO-Net-for-OCTA-images.
References
Bulut, M., et al.: Evaluation of optical coherence tomography angiographic findings in Alzheimer’s type dementia. Br. J. Ophthalmol. 102(2), 233–237 (2018)
Chen, C.F.R., Fan, Q., Panda, R.: CrossViT: cross-attention multi-scale vision transformer for image classification. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 357–366 (2021)
De Jesus, D.A., et al.: Octa multilayer and multisector peripapillary microvascular modeling for diagnosing and staging of glaucoma. Transl. Vis. Sci. Technol. 9(2), 58–58 (2020)
Fu, H., Geng, Y., Zhang, C., Li, Z., Hu, Q.: RED-Nets: redistribution networks for multi-view classification. Inf. Fusion 65, 119–127 (2021)
Guo, Z., Li, X., Huang, H., Guo, N., Li, Q.: Medical image segmentation based on multi-modal convolutional neural network: study on image fusion schemes. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp. 903–907. IEEE (2018)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Heisler, M., et al.: Ensemble deep learning for diabetic retinopathy detection using optical coherence tomography angiography. Transl. Vis. Sci. Technol. 9(2), 20–20 (2020)
Hermessi, H., Mourali, O., Zagrouba, E.: Multimodal medical image fusion review: theoretical background and recent advances. Signal Process. 183, 108036 (2021)
Hughes, S., Yang, H., Chan-Ling, T.: Vascularization of the human fetal retina: roles of vasculogenesis and angiogenesis. Invest. Ophthalmol. Visual Sci. 41(5), 1217–1228 (2000)
Hugo, J., Ganguli, M.: Dementia and cognitive impairment: epidemiology, diagnosis, and treatment. Clin. Geriatr. Med. 30(3), 421–442 (2014)
Li, M., et al.: Image projection network: 3D to 2D image segmentation in octa images. IEEE Trans. Med. Imaging 39(11), 3343–3354 (2020)
Li, M., et al.: IPN-V2 and octa-500: methodology and dataset for retinal image segmentation. arXiv preprint arXiv:2012.07261 (2020)
Lin, L., et al.: BSDA-Net: a boundary shape and distance aware joint learning framework for segmenting and classifying OCTA images. In: de Bruijne, M., et al. (eds.) MICCAI 2021. LNCS, vol. 12908, pp. 65–75. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87237-3_7
Liu, M., Zhang, D., Shen, D.: Relationship induced multi-template learning for diagnosis of Alzheimer’s disease and mild cognitive impairment. IEEE Trans. Med. Imaging 35(6), 1463–1474 (2016)
Livingston, G., et al.: Dementia prevention, intervention, and care. Lancet 390(10113), 2673–2734 (2017)
Park, J., Woo, S., Lee, J.Y., Kweon, I.S.: BAM: bottleneck attention module. arXiv preprint arXiv:1807.06514 (2018)
Ryu, G., Lee, K., Park, D., Park, S.H., Sagong, M.: A deep learning model for identifying diabetic retinopathy using optical coherence tomography angiography. Sci. Rep. 11(1), 1–9 (2021)
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-CAM: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Wang, X., Shu, K., Kuang, H., Luo, S., Jin, R., Liu, J.: The role of spatial alignment in multimodal medical image fusion using deep learning for diagnostic problems. In: 2021 the 3rd International Conference on Intelligent Medicine and Health, pp. 40–46 (2021)
Yan, S., et al.: Multiview transformers for video recognition. arXiv preprint arXiv:2201.04288 (2022)
Zang, P., et al.: DcardNet: diabetic retinopathy classification at multiple levels based on structural and angiographic optical coherence tomography. IEEE Trans. Biomed. Eng. 68(6), 1859–1870 (2020)
Zhang, N., Ding, S., Liao, H., Jia, W.: Multimodal correlation deep belief networks for multi-view classification. Appl. Intell. 49(5), 1925–1936 (2018). https://doi.org/10.1007/s10489-018-1379-8
Zhang, S., et al.: Choriocapillaris changes are correlated with disease duration and MoCa score in early-onset dementia. Front. Aging Neurosci. 13, 192 (2021)
Zhang, Y.S., et al.: Parafoveal vessel loss and correlation between peripapillary vessel density and cognitive performance in amnestic mild cognitive impairment and early Alzheimer’s disease on optical coherence tomography angiography. PLoS ONE 14(4), e0214685 (2019)
Zhou, T., et al.: Deep multi-modal latent representation learning for automated dementia diagnosis. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11767, pp. 629–638. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32251-9_69
Zhou, T., Canu, S., Vera, P., Ruan, S.: 3D medical multi-modal segmentation network guided by multi-source correlation constraint. In: 2020 25th International Conference on Pattern Recognition (ICPR), pp. 10243–10250. IEEE (2021)
Acknowledgement
This work was supported in part by China Postdoctoral Science Foundation (2021M691437), the National Natural Science Foundation of China (62101236), Guangdong Provincial Department of Education (2020ZDZX3043), the Science and Technology Innovation Committee of Shenzhen City (20200925174052004 and JCYJ20200109140820699), and Guangdong Provincial Key Laboratory (2020B121201001).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, X. et al. (2022). Screening of Dementia on OCTA Images via Multi-projection Consistency and Complementarity. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13432. Springer, Cham. https://doi.org/10.1007/978-3-031-16434-7_66
Download citation
DOI: https://doi.org/10.1007/978-3-031-16434-7_66
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16433-0
Online ISBN: 978-3-031-16434-7
eBook Packages: Computer ScienceComputer Science (R0)
