Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Comment
  • Published:

Lessons learned from translating AI from development to deployment in healthcare

Nature Medicine volume 29, pages 1304–1306 (2023)Cite this article

Subjects

The application of an artificial intelligence (AI)-based screening tool for retinal disease in India and Thailand highlighted the myths and reality of introducing medical AI, which may form a framework for subsequent tools

This is a preview of subscription content, access via your institution

Relevant articles

Open Access articles citing this article.

Access options

Buy this article

  • Purchase on SpringerLink
  • Instant access to full article PDF
Buy now

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Myths and reality of developing medical AI.

References

  1. Gulshan, V. et al. JAMA 316, 2402–2410 (2016).

    Article  PubMed  Google Scholar 

  2. FDA. https://www.fda.gov/media/134754/download (2018).

  3. Krause, J. et al. Ophthalmology 125, 1264–1272 (2018).

    Article  PubMed  Google Scholar 

  4. Schaekermann, M. et al. Transl. Vis. Sci. Technol. 8, 40 (2019).

    Article  PubMed  PubMed Central  Google Scholar 

  5. Greenland, S. J. Clin. Epidemiol. 41, 1167–1174 (1988).

    Article  CAS  PubMed  Google Scholar 

  6. Abràmoff, M. D. et al. NPJ DigitMed. 1, 39 (2018).

    Google Scholar 

  7. Rajkomar, A. et al. Ann. Intern. Med. 169, 866–872 (2018).

    Article  PubMed  PubMed Central  Google Scholar 

  8. Faes, L. et al. Lancet Digit Health 1, e232–e242 (2019).

    Article  PubMed  Google Scholar 

  9. Ruamviboonsuk, P. et al. NPJ Digit Med. 2, 25 (2019).

    Article  PubMed Central  Google Scholar 

  10. Chia, M. A. et al. Br. J. Ophthalmol. https://doi.org/10.1136/bjo-2022-322237 (2023).

  11. Liu, X. et al. Ophthalmol Retina 6, 398–410 (2022).

    Article  PubMed  Google Scholar 

  12. Ruamviboonsuk, P. et al. Lancet Digit Health 4, e235–e244 (2022).

    Article  CAS  PubMed  Google Scholar 

  13. Beede, E. et al. in Proc. 2020 CHI Conference on Human Factors in Computing Systems 1–12 (Association for Computing Machinery, 2020).

  14. Pedersen, E. R. et al. NEJM Catalyst https://doi.org/10.1056/CAT.21.0096 (2021).

    Article  Google Scholar 

  15. Feng, J. et al. NPJ Digit Med. 5, 66 (2022).

    Article  PubMed  PubMed Central  Google Scholar 

  16. US FDA, Health Canada & UK MHRA. https://go.nature.com/3negsku (2021).

  17. Azizi, S. et al. Nat. Biomed. Eng. (in the press).

  18. Sellergren, A. B. et al. Radiology https://doi.org/10.1148/radiol.212482 (2022).

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We thank the Google and Verily teams involved in developing, delivering, and improving ARDA. We also thank to C. Chen and M. Howell for manuscript feedback and A. Iurchenko for the illustration concept. Our work was inspired by our partners continuously expanding access to high quality care such as R. Kim and his team at the Aravind Eye Hospital, P. Ruamviboonsuk and his team at the Rajavithi Hospital in Thailand, and J. Cuadros and his team at EyePACS.

Author information

Author notes

  1. Lily Peng

    Present address: Verily, South San Francisco, CA, USA

Authors and Affiliations

  1. Google Health, Palo Alto, CA, USA

    Kasumi Widner, Sunny Virmani, Jonathan Krause, Jay Nayar, Richa Tiwari, Elin Rønby Pedersen, Divleen Jeji, Naama Hammel, Yossi Matias, Greg S. Corrado, Yun Liu, Lily Peng & Dale R. Webster

Authors
  1. Kasumi Widner
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sunny Virmani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jonathan Krause
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jay Nayar
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Richa Tiwari
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Elin Rønby Pedersen
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Divleen Jeji
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Naama Hammel
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Yossi Matias
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Greg S. Corrado
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Yun Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Lily Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Dale R. Webster
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yun Liu.

Ethics declarations

Competing interests

All authors are employees of Google LLC and own Alphabet stock.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Widner, K., Virmani, S., Krause, J. et al. Lessons learned from translating AI from development to deployment in healthcare. Nat Med 29, 1304–1306 (2023). https://doi.org/10.1038/s41591-023-02293-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41591-023-02293-9

This article is cited by

Search

Advanced search

Quick links

Nature Briefing: Translational Research

Sign up for the Nature Briefing: Translational Research newsletter — top stories in biotechnology, drug discovery and pharma.

Get what matters in translational research, free to your inbox weekly. Sign up for Nature Briefing: Translational Research