Skip to main content

Application effect of an artificial intelligence-based fundus screening system: evaluation in a clinical setting and population screening

Abstract

Background

To investigate the application effect of artificial intelligence (AI)-based fundus screening system in real-world clinical environment.

Methods

A total of 637 color fundus images were included in the analysis of the application of the AI-based fundus screening system in the clinical environment and 20,355 images were analyzed in the population screening.

Results

The AI-based fundus screening system demonstrated superior diagnostic effectiveness for diabetic retinopathy (DR), retinal vein occlusion (RVO) and pathological myopia (PM) according to gold standard referral. The sensitivity, specificity, accuracy, positive predictive value (PPV) and negative predictive value (NPV) of three fundus abnormalities were greater (all > 80%) than those for age-related macular degeneration (ARMD), referable glaucoma and other abnormalities. The percentages of different diagnostic conditions were similar in both the clinical environment and the population screening.

Conclusions

In a real-world setting, our AI-based fundus screening system could detect 7 conditions, with better performance for DR, RVO and PM. Testing in the clinical environment and through population screening demonstrated the clinical utility of our AI-based fundus screening system in the early detection of ocular fundus abnormalities and the prevention of blindness.

Background

Ocular fundus abnormalities are the essential causes of blindness and can be induced by ocular fundus diseases as well as other eye diseases such as glaucoma. Notably, diabetic retinopathy (DR), the primary cause of blindness and visual impairment among working age people, causes more than 24,000 people to lose their vision [1]. Age-related macular degeneration (ARMD), whose etiology is dependent on both hereditary and environmental factors, is the most common cause of significant vision impairment in adults who are equal to or older than 50 years old [2]. Retinal vein occlusion (RVO), the second most prevalent blinding vascular retinal disorder after DR [3], is thought to affect up to 16.4 million individuals worldwide, with a frequency of 2.1% in those over the age of 40 [4]. One of the main causes of blindness in young adults is pathological myopia (PM), which occurs in high myopic individuals with posterior scleral staphyloma and maculopathy [5]. The leading cause of ocular illnesses that result in blindness is glaucoma [6], and it is predicted that the number of glaucoma patients may reach 111.8 million by 2040 [7]. All of these findings show that aberrations of the ocular fundus can occur at any age and typically results in irreversible blindness. For ocular fundus abnormalities, early detection and identification are crucial for prevention and treatment due to the gradual destruction of ocular fundus structure and function [8].

Based on ocular imaging technologies, AI screening systems have the advantages of being simple to use, resource saving, and appropriate for use in primary regions [9]. These systems have the potential to become a future trend in ocular fundus abnormality screening, particularly in primary regions, as a result of its ability to assist primary healthcare facilities in diagnosing patients with ocular fundus abnormalities earlier and providing patients with treatment options or advice on referrals. Internationally, there is no widely used AI-based fundus screening system. The robust learning capacity of our transfer learning algorithm has been proved by retinal optical coherence tomography (OCT) images and chest radiographs [10]. Our transfer learning system could give highly effective classifications even under a very limited training dataset [10]. Notably, color fundus photography (CFP) is safe and effective and has a higher diagnostic efficiency even for glaucoma [11]. Kashi Prefecture is a significant area for the prevention of blindness and the ideal location for our AI screening system test due to its huge population base and dispersed population distribution. We used our AI screening system that can classify 7 conditions, including 5 common ocular fundus abnormalities, ARMD, DR, RVO, PM and glaucoma, to evaluate the viability of the system in this region and the efficacy of its application in primary population screening.

Results

Basic information

A total of 637 color fundus images from the ophthalmic clinic and 20,355 images from the physical examination center were collected for the evaluation in the clinical environment and the population screening, respectively. For the evaluation in the clinical environment, there were 158 males (48.32%) and 169 females (51.68%). Their ages ranged between 4 and 87, with an average of 48.18 ± 18.83 years old. For the population screening, there were 5481 males (52.52%) and 4956 females (47.48%). Their ages ranged between 2 and 103 years old, with the average of 46.31 ± 15.78 years old (Table 1).

Table 1 Characteristics of patients whose color fundus photographs were included in the study

Diagnostic condition distribution

The diagnostic results of AI included 436 normal, 29 ARMD, 16 DR, 17 RVO, 74 referable glaucoma, 48 PM and 17 other abnormalities, while the gold standard diagnostic results showed 391 normal, 14 ARMD, 17 DR, 14 RVO, 55 referable glaucoma, 44 PM and 102 other abnormalities. The diagnostic results of AI population screening included 15,779 normal, 653 ARMD, 713 DR, 248 RVO, 2146 referable glaucoma, 350 PM and 466 other abnormalities. The percentages of different diagnostic conditions in the two application environments were compared (Fig. 1). The comparisons for age and sex in the clinical AI evaluation and population screening was also analyzed (Fig. 2).

Fig. 1
figure 1

Percentage of diagnostic results for AI and gold standard referral. The percentages of 7 conditions in clinical application environment and population screening are shown and compared. ARMD age-related macular degeneration, DR diabetic retinopathy, RVO retinal vein occlusion, PM pathological myopia

Fig. 2
figure 2

Comparison of age and sex in the clinical AI application environment and population screening. a Comparison of the average age in the clinical environment and population screening. b Comparison of the sex percentage in the clinical environment and population screening

Evaluation of AI application in the clinical environment

Regarding the validity of the AI, RVO showed the highest sensitivity and the lowest false negative rate (FNR) and negative likelihood ratio (LR-), while other abnormalities showed the highest specificity and the lowest false positive rate (FPR). DR had the highest positive likelihood ratio (LR +) (Table 2, Fig. 3). Regarding precision, RVO showed the highest accuracy and the strongest Kappa value. About application effect, RVO had the highest NPV, while other abnormalities had the highest PPV (Table 3, Fig. 3). For normal, ARMD, DR, RVO, Referable glaucoma and PM, the AI screening system achieved an area under the ROC curve greater than 0.8 (Fig. 4).

Table 2 The validity of AI for clinical examination
Fig. 3
figure 3

Comparison of different diagnostic results in AI clinical examination. a Sensitivity comparison of 7 diagnostic results. b Specificity comparison of 7 diagnostic results. c Accuracy comparison of 7 diagnostic results. d PPV comparison of 7 diagnostic results. e NPV comparison of 7 diagnostic results. PPV, positive predictive value; NPV, negative predictive value

Table 3 Evaluation of the precision and application effect of AI
Fig. 4
figure 4

The receiver operating characteristic curve for every condition. a ROC curve and AUC for normal. b ROC curve and AUC for ARMD. c ROC curve and AUC for DR. d ROC curve and AUC for RVO. e ROC curve and AUC for referable glaucoma. f ROC curve and AUC for PM. g ROC curve and AUC for other abnormalities. AUC, areas under receiver operating characteristic curve

Discussion

It was previously demonstrated that, after training with images from common fundus imaging examinations such as CFP and OCT, an AI-based fundus diagnostic system could diagnose ocular fundus disorders like ARMD, DR [12] and glaucomatous optic neuropathy (GON). The substantial application value of AI-based screening systems for the early diagnosis of ocular fundus disorders has gained increasing attention [13]. There are many ways to examine the ocular fundus, and a previous study showed that an AI system based on OCT has sensitivity and specificity for high myopia that can exceed 80% [5]. However, to make a diagnosis, several image slices of a specified region needed to be scanned, which is unsuitable for fundus disease screening in primary medical institutions due to the low efficiency and equipment burden of the process. Additionally, multimodal imaging [14] is thorough and shows excellent performance for diagnosing ocular fundus abnormalities, but the combination of examination methods varies and depends on the specific diseases [15], making its application at primary hospitals more challenging. CFP, with the advantages of fewer images that need to be analyzed, ease of handling and low cost [16], has become the required test for ocular fundus examination and is more suitable for fundus screening in primary medical institutions [17].

There is currently no generally recognized standard for the validity of AI diagnosis systems. However, for AI-based DR diagnostic systems, screening guidelines suggest that sensitivity and specificity should be more than 80% [18]. Our study was a real-world study [19], and the AI-based fundus screening system we used in our study revealed that the sensitivity and specificity for ARMD, DR, RVO and PM were all above 80%, demonstrating the high degree of coincidence between AI and the gold standard referral diagnosis. The accuracies of diagnosing ARMD, DR, RVO and PM also surpassed 80%, showing the high stability of repeat examination for the same color fundus image. DR, RVO and PM all showed PPV and NPV values that exceeded 80%. After examining indicators for validity, precision and application effect in the clinical application environment, it was determined that among the five disorders, the screening capabilities of the AI system for DR, RVO and PM were better. Currently, only one CFP-based screening system for DR has been authorized by Food and Drug Administration (FDA), with the sensitivity and specificity surpassing 80%, which proved the feasibility of screening for DR in primary care settings [1]. In addition, the sensitivity and specificity of the AI system based on CFP for RVO [17], PM [20] and ARMD [2] was also able to exceed 80%, which was in line with our results.

Previously, an AI system based on CFP for multiple ocular fundus diseases only had an accuracy of 30.5% and Kappa value of 0.224 [21]. Additionally, there is an AI diagnostic system that can recognize a variety of fundus abnormalities, including hemorrhage, drusen, and any vascular abnormality [22]. For clinicians who would become fatigued after long working hours, this system was helpful for finding every subtle abnormality. However, due to the Al’s inability to provide a definite illness classification and the fact that the same fundus abnormality could be present in a variety of ocular fundus diseases, its application value in primary care was constrained. When 6 abnormal categories were included, the accuracy of the AI system in our study was up to 86.66% and the Kappa value was 0.709. This reflected the higher conformity, precision and more stable diagnosis for our AI system. Our results showed that the percentages of different conditions were similar in the clinical AI application environment and population screening for ARMD, DR, RVO and referable glaucoma. The percentages of PM and other abnormalities in population screening were only slightly less than those in the ophthalmic clinic. These results all demonstrated the beneficial effect of our AI-based fundus system for fundus screening and epidemiological research. Because there were more healthy people in the physical examination center than in the ophthalmic clinic, the percentage of normal in the population screening was higher than that in the clinical environment.

The specificity, accuracy and middle Kappa conformity strength of the AI system in clinical environment evaluation for referable glaucoma all exceeded 80%; however, the sensitivity was only 65.45%. Regarding the indicators of the application effect, the NPVs of ARMD and referable glaucoma were greater than 80%, while the PPVs of two abnormalities were low, with a PPV of 48.65% for referable glaucoma and 44.83% for ARMD. The sensitivity of referable glaucoma was low, and the FNR was 34.55%. The reasons are analyzed as below. The acute angle-closure glaucoma patients in the preclinical phase who did not have ocular fundus abnormalities and the eyes that had undergone anti-glaucoma surgery and had a relatively normal optic nerve made up the majority of the missed referable glaucoma cases. Additionally, early GON has a similar appearance to a normal optic disc, and ocular fundus injury in glaucoma patients with a small optic disc is difficult to detect, making it challenging to diagnose. There is a sequence for the optic disc structure injury and vision field defects, and the fluctuation often occurs in the early stage of vision field defects. Therefore, missed diagnosis occurs when vision field defects are present, but the optic nerve head (ONH) injury is not obvious. The low PPV of referable glaucoma was mainly due to optic atrophy, normal eyes and PM, which was similar to the results of Li et al. [6]. In addition to GON, other conditions, such as various optic neuropathies, trauma and hereditary diseases, could also contribute to optic atrophy. The form of the optic disc clearly varies in normal eyes, and physiologic large cup is often misdiagnosed as glaucoma. All of these factors can lead to misdiagnosis in the real clinical environment. When the pale area of the optic disc is larger than the sink region, diseases other than glaucoma should be considered. Moreover, PM can be misdiagnosed as glaucoma because of lateral optic atrophy, and myopia is one of the risk factors for open-angle glaucoma [23].

The PPV of ARMD in AI clinical examination is low, and misdiagnoses mainly included retinal detachment (RD), macular hole (MH) and macular epiretinal membrane. The fact that ARMD is one of the age-related degenerative pathological changes that can result in MH [24] is a significant factor contributing to misdiagnosis. In addition, ARMD can be classified as dry (atrophy type) and wet (exudative type) depending on the presence of hemorrhage, exudation and edema. Dry ARMD can display “gold foil”-like light reflection that is similar to the macular epiretinal membrane, while wet ARMD can exhibit serous and/or hemorrhagic RD. Low PPV may be caused by both the diversity of ARMD fundus abnormalities and the limitations of two-dimensional color fundus images. For other abnormalities, the specificity, accuracy, PPV and NPV were more than 80%, while the sensitivity was only 15.69%, and the Kappa value was reasonable. All of these results demonstrated that the AI-based fundus screening system had a relatively limited capability of recognizing ocular fundus abnormalities other than ARMD, DR, RVO, referable glaucoma and PM. The missed diagnosis of other abnormalities for the AI system mainly occurred in optic atrophy cases, which could be caused by a number of diseases, such as diabetes. There were 45 patients with optic atrophy who were under 50 years old, had no systemic or ocular medical history, and required further examination to determine the cause of their optic atrophy. For normal subjects, the sensitivity, accuracy, PPV and NPV exceeded 80%, and the Kappa conformation strength was high. However, the specificity was relatively low, 73.58%, demonstrating that AI system misdiagnosed some abnormal eyes, which mainly included diagnoses of glaucoma with inconspicuous GON and optic atrophy that should been classified as other abnormalities.

There was a preexisting AI system based on CFP designed to identify 4 diseases from 420 retinal images, such as DR and RVO [25]. The sensitivity, specificity and accuracy were all above 80%, demonstrating the broad application potential of this AI-based fundus diagnostic system. In this study, we proved the better application value of our proposed AI-based fundus screening system by choosing a larger sample size, more plentiful disease types, and collecting data from both a real clinical environment, and conducting a population screening of a large sample. Our study still has some limitations. Firstly, this study’s glaucoma screening effectiveness was insufficient. Our algorithm for learning cup–disc ratio is currently being updated. In addition to CFP, we take into account algorithm learning to combine anterior segment ocular manifestations and the vision field [26]. Second, our system needs to output more accurate and comprehensive diagnoses. We must provide more precise disorder stages, such as those for DR [27]. Every disorder that can be diagnosed from a color fundus image must be included in our future AI screening system. It has been proven that CFP can be adopted in AI-based cataract diagnostic systems [28], and sometimes multiple diseases can appear in a color fundus image simultaneously, such as RVO combined with glaucoma. Finally, considering the intense relationship between ocular diseases and hereditary or systematic diseases, we should combine our algorithm with systemic indicators such as glycosylated hemoglobin (HbA1c) [29] when diagnosing DR. Additionally, we also need to diagnose any possible systematic diseases from ophthalmic images [30].

Conclusions

The AI-based fundus screening system used in this study is able to distinguish between normal and abnormal ocular fundus as well as diagnose 5 prevalent ocular conditions. Combining the indicators of validity, precision and application effect in a real clinical environment, the screening efficacies for DR, RVO and PM are more favorable. The system’s ability to recognize ARMD and referable glaucoma still need to be improved. The epidemiologic data from the ophthalmic clinic reveal that certain patients with optic atrophy are young and lack ophthalmic or systemic disorders, which likely indicates an epidemiologic trait in the local area and requires further study to determine the cause.

Methods

Image collection

All investigations were carried out according to the Declaration of Helsinki and were approved by the institutional review board of the First People’s Hospital of Kashi Prefecture (No. 2019ksd-86). Every participant provided informed consent. To evaluate the clinical application of AI, 637 color fundus images of 327 patients from an ophthalmic clinic were collected. A total of 20,355 color fundus images of 10,437 individuals from a physical examination center were included for the evaluation of the general population screening. Only one image was included for each examined eye. Eyes with one of the following criteria were excluded: refractive medium opacity, eyeball excision, atrophy of the eyeball, and poor cooperation leading to inferior image quality. The flowchart in Fig. 5 depicts the inclusion procedure.

Fig. 5
figure 5

Flowchart for testing the AI fundus screening system

AI system workflow

Color fundus images were captured with a fully automatic nonmydriatic fundus camera (RetiCam 3100, Shenzhen New Vision Technology Co., Ltd.) with installed AI-based fundus screening software (Kangrui Intelligent Technology Co., Ltd., Guangzhou, China). The AI system’s standard color fundus image met the following criteria [31]: (1) the photo was taken using a single field of view with at least a 45° retinal scope. (2) The center of the shooting field was defined as the midpoint of the connecting line between the fovea and the optic disc. (3) The focus of the image was between the fovea and the optic disc. (4) The structure of the optic disc, the fovea and the first superior and inferior branches of the retinal vascular arch could be observed in the image. (5) The image showed the 2-diameter region surrounding the optic disc. (6) The image had a 1024 × 1024 resolution.

When the eligible color fundus images were input into the AI software, the system could output one of the following conditions: normal, ARMD, DR, RVO, referable glaucoma, PM and other abnormalities. The gold standard referral for every condition was evaluated by two highly competent ophthalmic chief clinicians with more than 20 years of clinical experience according to the international diagnostic criteria (Table 4). When the two medical professionals disagreed, the gold standard referral outcome was determined by a third ophthalmic chief clinician with more than 20 years of clinical experience according to international guidelines.

Table 4 Diagnostic criteria for different conditions

Statistical analysis

All statistical analyses were performed using SPSS Statistics version 26 (IBM Corporation). For clinical application examination, evaluation indicators include validity, precision and application effect. The validity and degree of coincidence between the AI and human diagnoses were measured with sensitivity, false negative rate (FNR), specificity, false positive rate (FPR), positive likelihood ratio (LR +), negative likelihood ratio (LR-), Youden index and area under receiver operating characteristic (ROC) curve (AUC). The precision was evaluated by accuracy and Kappa value. The conformance strength of Kappa was determined in reference to the Landis & Koch criterion (Table 5). The application effect was evaluated by the positive predictive value (PPV) and negative predictive value (NPV). The figures were created in Origin 2022b (OriginLab Corporation). All the hypothesis tests were 2-sided, and a P value of less than 0.05 was considered significant.

Table 5 Evaluation criterion for Kappa value

Availability of data and materials

The datasets of clinical examination and population screening that we used in this study are sourced from the First People’s Hospital of Kashi Prefecture. The availability of datasets is restricted under the agreement for the current study, so we are unable to make the datasets publicly available immediately. However, datasets and corresponding annotations can be made available upon reasonable request and with the permission of the regular and respectable research institutes. Please contact the first author Shujuan Cao (caoshujuancsj@126.com) for the request of data access.

Abbreviations

AI:

Artificial intelligence

AUC:

Areas under receiver operating characteristic curve

ROC:

Receiver operating characteristic

ARMD:

Age-related macular degeneration

DR:

Diabetic retinopathy

GON:

Glaucomatous optic neuropathy

CFP:

Color fundus photography

OCT:

Optical coherence tomography

DL:

Deep learning

RVO:

Retinal vein obstruction

PM:

Pathological myopia

FNR:

False negative rate

FPR:

False positive rate

LR + :

Positive likelihood ratio

LR−:

Negative likelihood ratio

PPV:

Positive predictive value

NPV:

Negative predictive value

FDA:

Food and Drug Administration

ONH:

Optic nerve head

RD:

Retinal detachment

MH:

Macular hole

HbA1c:

Glycosylated hemoglobin

References

  1. Abràmoff MD, Lavin PT, Birch M, et al. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. NPJ Digit Med. 2018;1:39.

    Article  Google Scholar 

  2. Grassmann F, Mengelkamp J, Brandl C, et al. A deep learning algorithm for prediction of age-related eye disease study severity scale for age-related macular degeneration from color fundus photography. Ophthalmology. 2018;125(9):1410–20.

    Article  Google Scholar 

  3. Karagiannis D, Kontadakis GA, Klados NE, et al. Central retinal vein occlusion and pseudoexfoliation syndrome. Clin Interv Aging. 2015;10:879–83.

    Google Scholar 

  4. Nagasato D, Tabuchi H, Masumoto H, et al. Automated detection of a nonperfusion area caused by retinal vein occlusion in optical coherence tomography angiography images using deep learning. PLoS ONE. 2019;14(11): e0223965.

    Article  Google Scholar 

  5. Li Y, Feng W, Zhao X, et al. Development and validation of a deep learning system to screen vision-threatening conditions in high myopia using optical coherence tomography images. Br J Ophthalmol. 2022;106(5):633–9.

    Article  Google Scholar 

  6. Li Z, He Y, Keel S, et al. Efficacy of a deep learning system for detecting glaucomatous optic neuropathy based on color fundus photographs. Ophthalmology. 2018;125(8):1199–206.

    Article  Google Scholar 

  7. Liu H, Li L, Wormstone IM, et al. Development and validation of a deep learning system to detect glaucomatous optic neuropathy using fundus photographs. JAMA Ophthalmol. 2019;137(12):1353–60.

    Article  Google Scholar 

  8. Toğaçar M. Detection of retinopathy disease using morphological gradient and segmentation approaches in fundus images. Comput Methods Programs Biomed. 2022;214: 106579.

    Article  Google Scholar 

  9. Bellemo V, Lim ZW, Lim G, et al. Artificial intelligence using deep learning to screen for referable and vision-threatening diabetic retinopathy in Africa: a clinical validation study. Lancet Digit Health. 2019;1(1):e35-44.

    Article  Google Scholar 

  10. Kermany DS, Goldbaum M, Cai W, et al. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell. 2018;172(5):1122-31.e9.

    Article  Google Scholar 

  11. Xu X, Guan Y, Li J, et al. Automatic glaucoma detection based on transfer induced attention network. Biomed Eng Online. 2021;20(1):39.

    Article  Google Scholar 

  12. Rahimy E. Deep learning applications in ophthalmology. Curr Opin Ophthalmol. 2018;29(3):254–60.

    Article  Google Scholar 

  13. Saleh GA, Batouty NM, Haggag S, et al. The role of medical image modalities and AI in the early detection, diagnosis and grading of retinal diseases: a survey. Bioengineering (Basel). 2022;9(8):366.

    Article  Google Scholar 

  14. Flores-Moreno I, Puertas M, Almazán-Alonso E, et al. Pathologic myopia and severe pathologic myopia: correlation with axial length. Graefes Arch Clin Exp Ophthalmol. 2022;260(1):133–40.

    Article  Google Scholar 

  15. Chaikitmongkol V, Khunsongkiet P, Patikulsila D, et al. Color fundus photography, optical coherence tomography, and fluorescein angiography in diagnosing polypoidal choroidal vasculopathy. Am J Ophthalmol. 2018;192:77–83.

    Article  Google Scholar 

  16. Du XL, Li WB, Hu BJ. Application of artificial intelligence in ophthalmology. Int J Ophthalmol. 2018;11(9):1555–61.

    Google Scholar 

  17. Li B, Chen H, Zhang B, et al. Development and evaluation of a deep learning model for the detection of multiple fundus diseases based on colour fundus photography. Br J Ophthalmol. 2022;106(8):1079–86.

    Google Scholar 

  18. Li Z, Keel S, Liu C, et al. An automated grading system for detection of vision-threatening referable diabetic retinopathy on the basis of color fundus photographs. Diabetes Care. 2018;41(12):2509–16.

    Article  Google Scholar 

  19. Liu Y, Gao K, Deng H, et al. A time-incorporated SOFA score-based machine learning model for predicting mortality in critically ill patients: a multicenter, real-world study. Int J Med Inform. 2022;163: 104776.

    Article  Google Scholar 

  20. Wan C, Li H, Cao GF, et al. An artificial intelligent risk classification method of high myopia based on fundus images. J Clin Med. 2021;10(19):4488.

    Article  Google Scholar 

  21. Choi JY, Yoo TK, Seo JG, et al. Multi-categorical deep learning neural network to classify retinal images: a pilot study employing small database. PLoS ONE. 2017;12(11): e0187336.

    Article  Google Scholar 

  22. Son J, Shin JY, Kim HD, et al. Development and validation of deep learning models for screening multiple abnormal findings in retinal fundus images. Ophthalmology. 2020;127(1):85–94.

    Article  Google Scholar 

  23. Hemelings R, Elen B, Blaschko MB, et al. Pathological myopia classification with simultaneous lesion segmentation using deep learning. Comput Methods Programs Biomed. 2021;199: 105920.

    Article  Google Scholar 

  24. Michalewska Z, Nawrocki J. Vitrectomy with the inverted internal limiting membrane flap technique in eyes with full-thickness macular hole and dry age-related macular degeneration. Eur J Ophthalmol. 2021;31(3):1320–5.

    Article  Google Scholar 

  25. Anitha J, Vijila CK, Selvakumar AI, et al. Automated multi-level pathology identification techniques for abnormal retinal images using artificial neural networks. Br J Ophthalmol. 2012;96(2):220–3.

    Article  Google Scholar 

  26. Xiong J, Li F, Song D, et al. Multimodal machine learning using visual fields and peripapillary circular OCT scans in detection of glaucomatous optic neuropathy. Ophthalmology. 2022;129(2):171–80.

    Article  Google Scholar 

  27. Liu R, Li Q, Xu F, et al. Application of artificial intelligence-based dual-modality analysis combining fundus photography and optical coherence tomography in diabetic retinopathy screening in a community hospital. Biomed Eng Online. 2022;21(1):47.

    Article  Google Scholar 

  28. Yang JJ, Li J, Shen R, et al. Exploiting ensemble learning for automatic cataract detection and grading. Comput Methods Programs Biomed. 2016;124:45–57.

    Article  Google Scholar 

  29. Stevenson CH, Hong SC, Ogbuehi KC. Development of an artificial intelligence system to classify pathology and clinical features on retinal fundus images. Clin Exp Ophthalmol. 2019;47(4):484–9.

    Article  Google Scholar 

  30. Poplin R, Varadarajan AV, Blumer K, et al. Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nat Biomed Eng. 2018;2(3):158–64.

    Article  Google Scholar 

  31. Glaucoma Group of Chinese Medical Association Ophthalmology Society, Ophthalmic Artificial Intelligence Group of Chinese Medical Equipment Association. Guidelines for the standardized design and application of an AI-based glaucoma auxiliary screening system based on fundus photography in China (2020). Zhonghua Yan Ke Za Zhi. 2020;56(6):423–32.

  32. Delori FC, Gragoudas ES, Francisco R, et al. Monochromatic ophthalmoscopy and fundus photography. The normal fundus. Arch Ophthalmol. 1977;95(5):861–8.

    Article  Google Scholar 

  33. Deng Y, Qiao L, Du M, et al. Age-related macular degeneration: Epidemiology, genetics, pathophysiology, diagnosis, and targeted therapy. Genes Dis. 2022;9(1):62–79.

    Article  Google Scholar 

  34. Abràmoff MD, Folk JC, Han DP, et al. Automated analysis of retinal images for detection of referable diabetic retinopathy. JAMA Ophthalmol. 2013;131(3):351–7.

    Article  Google Scholar 

  35. Jaulim A, Ahmed B, Khanam T, et al. Branch retinal vein occlusion: epidemiology, pathogenesis, risk factors, clinical features, diagnosis, and complications. An update of the literature. Retina. 2013;33(5):901–10.

    Article  Google Scholar 

  36. Foster PJ, Buhrmann R, Quigley HA, et al. The definition and classification of glaucoma in prevalence surveys. Br J Ophthalmol. 2002;86(2):238–42.

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank Kangrui Intelligent Technology Co., Ltd. for their assistance in the design of AI software.

Funding

This study was partly supported by Science and Technology Program of Guangzhou, China (No. 202102020736), Natural Science Foundation of Xinjiang Uygur Autonomous Region (No. 2019D01C004), Xinjiang Uygur Autonomous Region Innovation Environment (Talents, Bases) Special Project (Special Talent Project-Tianshan Youth Project) (No. 2019Q145) and The Pearl River Scholar Tianshan Talent Cooperation’s Expert Studio Innovation Team (No. KDYY202018).

Author information

Authors and Affiliations

Authors

Contributions

SC, RZ, XL, RC, AW, AJ and JW designed this study. SC, RZ, AJ, MK, KX, MA and AT collected and interpreted the data. SC and RZ performed the statistical analysis and drafted the manuscript. SC, AJ and RC obtained funding for this study. XL and RC supervised this study. SC and RZ contributed equally to this work and share first authorship. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Xuanwei Liang or Rongxin Chen.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the institutional review board of the First People’s Hospital of Kashi Prefecture (No. 2019ksyd-86).

Consent for publication

Not applicable.

Competing interests

None of the authors have any financial/conflicting interests to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cao, S., Zhang, R., Jiang, A. et al. Application effect of an artificial intelligence-based fundus screening system: evaluation in a clinical setting and population screening. BioMed Eng OnLine 22, 38 (2023). https://doi.org/10.1186/s12938-023-01097-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12938-023-01097-9

Keywords