Trending Topic

23 mins

Trending Topic

Developed by Touch
Mark CompleteCompleted
BookmarkBookmarked
Luke G Qin, Michael T Pierce, Rachel C Robbins

The uvea is a vascular stratum that includes the iris, ciliary body and choroid. Uveitis is defined as inflammation of a part of the uvea or its entirety, but it is also used to describe inflammatory processes of any part of the eye, such as the vitreous or peripheral retina. The clinical taxonomy of uveitis […]

Predictive Deep Learning Applications in Ophthalmology

Neslihan Dilruba Koseoglu, TY Alvin Liu
Share
Facebook
X (formerly Twitter)
LinkedIn
Via Email
Mark CompleteCompleted
BookmarkBookmarked
Copy LinkLink Copied
Download as PDF
Published Online: Nov 10th 2023 touchREVIEWS in Ophthalmology. 2023;17(2):23-27 DOI: https://doi.org/10.17925/USOR.2023.17.2.4
Select a Section…
1

Abstract

Overview

Deep learning is a state-of-the-art machine learning technique used in medical image analysis. In recent years, there has been a growing interest in applying deep learning methods to perform prediction and prognostication tasks. Broadly speaking, these applications can be characterized as structure-structure prediction, structure-function prediction, disease onset/progression prediction and treatment response prediction. This review aims to summarize the most recent studies in this area, with a particular focus on age-related macular degeneration, diabetic retinopathy and glaucoma.

Keywords
2

Article

The term ‘artificial intelligence’ was coined by a group of scientists during a workshop known as the “Dartmouth Summer Research Project on Artificial Intelligence” in 1956.1 The concept was based on the idea that “intelligent human behavior consisted in processes that could be formalized and reproduced in machine”.1 The subfield of machine learning (ML) aims to train algorithms to recognize patterns from a large amount of data using extracted features. However, these features require manual extraction, which is labour intensive. Examples of this method include random forests, support vector machines and decision trees.2 Currently, deep learning (DL) is considered the state-of-the-art ML technique, and these DL algorithms are largely preferred in medical image analyses. In contrast to classical ML, DL algorithms do not require manual feature extraction and typically involve multi-layered artificial neural networks (NN).2–4 In ophthalmology, DL models have been successfully applied to various imaging modalities, including colour fundus photography (CFP), optical coherence tomography (OCT) and visual field (VF) testing.

Broadly speaking, DL models have been deployed in ophthalmology for the following purposes: classification, segmentation and prediction. Most of the published studies to date have focused on classification tasks, such as classifying whether a particular colour fundus image contains referral diabetic retinopathy (DR). In recent years, predictive DL models have become an area of particular interest for researchers, as they could be used as clinical decision-support tools. They also could, within certain contexts, make predictions that are beyond the capabilities of human clinicians.

In this review, we aim to highlight predictive DL models by organizing published manuscripts in this area into the following themes: structure-structure prediction, structure-function prediction, disease onset/progression prediction and treatment response prediction. In addition, we focus on three major diseases that can lead to blindness, namely age-related macular degeneration (AMD), DR and glaucoma.

Methods

The PubMed database was searched for original investigations published between January 2017 and March 2023 using the following keywords: “deep learning”, “artificial intelligence”, “prediction”, “age-related macular degeneration”, “diabetic retinopathy” and “glaucoma”. Initially, 77 original research articles were identified. Studies that included only classical ML were excluded from our final review.

Structure-structure prediction

CFP, an easily accessible imaging tool, is widely used as a screening modality for retinal and optic nerve head pathologies.5–7 The advent of OCT has further revolutionized ophthalmology, as it can image ocular tissue noninvasively, with micro-level resolution. Compared with CFP, OCT images can provide much more valuable medical information due to the higher resolution and 3D nature of OCT volumes. However, OCT imaging is limited by its relatively narrow field of view and the costly, non-portable nature of OCT machines. Therefore, DL models that can predict OCT metrics or characteristics directly from CFP can be invaluable.

Diabetic retinopathy

In the management of DR, increased central foveal thickness (CFT) due to diabetic macular oedema (DMO) deteceted on OCT is an important indication for anti-vascular endothelial growth factor (anti-VEGF) therapy. Studies have shown that eyes with DMO shown on OCT images may not have obvious features, such as lipid exudates, in CFP.8 To address the limited sensitivity in detecting DMO from CFP, two studies trained DL models to predict CFT and quantitative retinal fluid metrics on OCT directly from CFP.9,10 Both studies showed promising results, with an area under the receiver operating curve (AUC) ranging from 0.89 (95% confidence interval [CI] 0.87–0.91) in predicting centre involving DMO to 0.97 (95% CI 0.89–1.00) in predicting CFT above 250 microns on spectral-domain OCT (SD-OCT).9,10

Glaucoma

CFPs were also used for predicting retinal thickness on OCT images in glaucoma. Glaucomatous damage is defined by the thinning of the retinal nerve fibre layer (RNFL) and corresponding VF defects. Medeiros et al. trained a DL model to predict progressive thinning of RNFL on OCT directly from longitudinal CFP.11 The model predicted progressive damage, with an AUC of 0.86 (95% CI 0.83–0.88), and the predicted RNFL thickness values were significantly correlated with the observed RNFL values (r=0.76; 95% CI 0.70–0.80).11 Similarly, a hybrid DL + classical ML model (pre-trained DL model + support vector machine) was developed by Lee et al. to predict macular ganglion cell layer-inner plexiform layer (mGCL-IPL) thickness on OCT using red-free RNFL photography.12 Their model’s predictions were strongly correlated with the measurements taken by human experts (correlation coefficient r=0.739, mean absolute error [MAE] 4.76  µm; p<0.001).12

Clinical implications

The vast majority of the published studies to date on this topic centred on using DL and CFPs to predict OCT characteristics and metrics. This has huge implications for decentralized monitoring in a non-ophthalmology setting. In general, OCT machines are much more expensive than devices capturing CFPs, and OCT machines are typically only available at ophthalmology clinics. In contrast, a plethora of options exist for capturing CFPs, including low-cost, portable colour fundus cameras, and these devices could be paired with structure-structure predictive DL models for at-home monitoring. For example, a patient with known DR could undergo regular fundus imaging at home, and the captured CFPs could be analysed by a DL model to monitor for central macular thickening due to DMO. Similarly, a patient with known glaucoma could undergo regular fundus imaging at home, and the captured CFPs could be analysed by a DL model to monitor for progressive RNFL thinning. As the next steps, DL models could also be trained to predict OCT angiography metrics, such as vascular density, from CFPs.

Structure-function prediction

DL models have been developed to predict various visual functions directly from images. Herein, we present four examples of models used in retinal diseases.

Age-related macular degeneration

Using OCT images from the phase III HARBOR (ClinicalTrials.gov identifier: NCT00891735) clinical trial,13,14 which involved monthly visits for patients with neovascular AMD (nAMD) undergoing anti-VEGF injections, Kawczynski et al. developed a DL model15 to predict visual acuity (VA) at every concurrent visit and VA at 12 months from baseline. The model achieved better overall results in predicting VA of the fellow eyes (AUC 0.98 at concurrent visits and AUC 0.96 at 12 months) compared with study eyes (AUC 0.92 at the concurrent visits and AUC 0.84 at 12 months).15

Balaskas et al. aimed to predict VA in patients with geographic atrophy (GA) under standard and low-luminance conditions.16 First, the OCT images were segmented using DL techniques. Then, a random forest regression model was trained using the segmented images to predict VA in Early Treatment of Diabetic Retinopathy Study (ETDRS) letters. 16 The model achieved r2 0.40 (MAE 11.7 ETDRS letters) predicting standard luminance VA and r2 0.25 (MAE 12.1 ETDRS letters) predicting low-luminance VA from OCT images.

Microperimetry (MP) is another important visual function assay that produces retinal sensitivity results comparable to standard automated perimetry but also has better anatomical-functional correspondence.17,18 Additionally, MP can effectively detect residual visual function in various ophthalmic conditions such as glaucoma, DR and AMD.19–21 In their review, Midena et al. also concluded that MP was superior in providing functional changes than VA in patients with AMD.19 Using images from healthy individuals and patients with nAMD and GA for training, Seebock et al. trained a DL model (ReSensNet) to directly predict retinal sensitivity on MP from OCT images.22 The model was then tested on an external dataset, consisting of eyes with DMO, retinal vein occlusion and epiretinal membrane. The MAE for point-wise sensitivity was 2.73 decibels (dB), and the MAE for mean sensitivity was 1.66 dB.22

Diabetic retinopathy

Lin et al. trained a DL model to predict visual impairment from OCT images of eyes with DME.23 Adequate vision was defined as a decimal VA of ≥0.05, and impaired VA was defined as a decimal VA of <0.05. The model achieved an AUC of 0.80 in predicting adequate versus impaired VA.23

Glaucoma

Besides retinal diseases, the majority of the structure-function prediction studies pertained to glaucoma, specifically in predicting VF results from images. VF testing is important for the management of patients with glaucoma, and is the gold standard tool in quantifying functional deficits in patients with glaucoma.

Various studies focused on predicting threshold sensitivity values in 24–2 standard automated perimetry from segmented OCT images.24–28 While the majority of these studies used SD-OCT imaging, Park et al. used swept-source OCT images, and the root mean squared error of the global prediction error for their model was 4.44 dB.25 Christopher et al. used RNFL en face images, laser scanning ophthalmoscopy images and RNFL thickness measurements to predict 24–2 VF, and their model achieved an R2 of 0.70 and MAE of 2.5 dB, outperforming a model that was only trained with RNFL thickness measurements.28 Two other studies developed DL models to predict 24–2 VF results from unsegmented SD-OCT images and achieved similar results. The model developed by Hemelings et al. had an MAE of 4.82 (4.45–5.22) dB.29 Kihara et al. trained their EfficientNet B2 model with both unsegmented OCT images and infrared reflectance images to predict each of the 52 sensitivity points on the 24–2 VF, and their model had an MAE of 0.485 (0.438–0.533).30

Other glaucoma studies focused on the central 10° region and on predicting 10–2 VF sensitivity values.31–35 Xu et al. trained DL models with segmented SD-OCT images (mGCL-IPL, RNFL and outer segment + retina pigment epithelium) to predict VF sensitivity at each point.34 The MAE for the whole VF was 2.72 ± 2.60 dB for convolutional neural networks-tensor regression, one of the DL models.34 Hashimato et al. developed a pattern-based regularization convolutional neural network-pattern-based regularization with segmented SD-OCT images (mGCL-IPL, RNFL and outer segment + retina pigment epithelium), and their proposed model outperformed classical ML models, achieving an MAE of 2.84 (±2.98) dB.31 Moon et al. used swept-source OCT images to develop two DL models to predict 10–2 VF.35 The MAE for global prediction was 3.10 dB for the model that was trained with mGCL-IPL thickness maps and wide-field en face images and 3.17 dB for the model that was trained with mGCL-IPL thickness maps and RNFL thickness.35

Christopher et al. used macular SD-OCT images to estimate 10–2 and 24–2 VF results. The model, which took into account six segmented retinal layers simultaneously, performed the best in predicting mean deviation values and achieved an MAE of 1.9 dB (95% CI 1.6–2.4 dB) for 10–2 VF and 2.1 dB (95% CI 1.8–2.5 dB) for 24–2 VF testing.36

Lastly, Shamsi et al.37 aimed to predict retinal contrast sensitivity in patients with AMD and glaucoma from segmented OCT images. The model was trained on healthy individuals, patients with AMD and patients with glaucoma. The authors reported that mGCL and IPL thicknesses and reflectivity of retinal ganglion cells were significantly correlated with contrast sensitivity, and this correlation was corroborated by class activation maps of the images in the test set. The model achieved an MAE of 0.13 ± 0.011 in predicting Pelli–Robson contrast sensitivity values for all subjects.37

Clinical implications

In ophthalmology, the most widely used functional metric is VA. However, this metric has limitations since, in many common ophthalmic conditions such as glaucoma and retinitis pigmentosa, VA is not affected until the end-stage disease has set in. As alternatives to VA, many functional assays, such as VF and contrast sensitivity, are used in clinical trials and in routine clinical practice, but these alternative assays are typically time consuming and labour intensive. They are also limited by patient and operator variability. In contrast, imaging tests are generally more readily available, reliable and repeatable than functional tests. Therefore, DL models that can predict functional status from objective imaging hold great promise in revolutionizing the way that we assess and monitor functional endpoints in various ophthalmic diseases. A major limitation of this approach is the sheer number of possible combinations of imaging and functional tests. Datasets with paired data points will be needed to train such DL models: for example, paired optic nerve OCT and VF for glaucoma and paired fundus autofluorescence (FAF) and contrast sensitivity for GA. Collecting and curating such datasets require significant resources and effort, so for a given condition, it will be more practical and scalable for experts to agree on and perhaps standardize the optimal combination of imaging and functional tests first before proceeding with large-scale data collection in the future.

Disease onset/progression prediction

Age-related macular degeneration

Several studies used OCT images to predict progression from early/intermediate to advanced AMD in the fellow eye of patients with nAMD in one eye.38–40 Russakoff et al. pre-processed the OCT images in the training set using segmentation and improved the performance of their model (AMDnet) to an AUC of 0.89 at the scan level and 0.91 at the volume level.38 On the other hand, Yim et al. used both segmented and raw OCT volumes for training, and their model achieved an AUC of 0.745 in predicting imminent (6 months) conversion to nAMD; in a head-to-head comparison, this system outperformed the three retinal specialists and two optometrists and showed an equivalent performance to the remaining human expert on the panel.39 Finally, Banerjee et al. developed a hybrid model, combining patient demographic information, VA and OCT image features.40 The model achieved an AUC of 0.82 in predicting conversion to nAMD within 3 months and an AUC of 0.68 in predicting conversion to nAMD within 21 months.

A number of studies used CFPs from the Age-Related Eye Disease Study (AREDS) clinical trial to train their neural networks.41–45 Bhujyan et al. applied a two-step approach: (1) classification of images according to disease severity using DL and (2) prediction of progression to advanced AMD using classical ML.43 The hybrid model achieved 84% accuracy in predicting advanced AMD development (GA and nAMD) within 2 years.43 Ganjdanesh et al. developed a generative adversarial network (GAN) that learned from temporal, longitudinal changes in CFPs; this model achieved an accuracy of 0.762 (95% CI 0.733–0.792) in simultaneously grading disease severity at the current time point and in predicting progression to late AMD at a future time point.45 Lastly, Liefers et al. trained their DL model with automatically segmented CFPs to predict GA growth rate.46 The dataset included patients from the Rotterdam study and Blue Mountain Eye Study for training and patients from the AREDS trial for validation.47,48 The model reached an interclass correlation of 0.83 between predicted and ground-truth GA areas.46

Other studies focused on the progression of dry AMD and GA. Gigon et al. developed a DL model to predict en face retinal pigment epithelium and outer retinal atrophy (RORA) progression on OCT, achieving a Dice score that ranged from 0.46 to 0.72 in predicting the RORA growth regions.49 Zhang et al. developed a bi-directional long short-term memory prediction module that had an average Dice ranging between 0.86 and 0.92 in predicting GA growth on SD-OCT images under different scenarios, and their model gained 10% in accuracy after the integration of time-related factors.50 Anegondi et al. developed two DL models for predicting GA growth rate.51 One model was trained with FAF images only. The second model was trained with both FAF and OCT images. Interestingly, the model trained with FAF images only actually performed better, with an AUC of 0.98 (0.97–0.99) in predicting GA growth rate.51 Kalra et al. focused on predicting degeneration of the ellipsoid zone on SD-OCT images, and the at-risk ellipsoid zone areas identified by their DL model showed an interclass correlation of 0.83 with the ground truth.52

Diabetic retinopathy

Compared with AMD, fewer studies investigated disease onset/progression within the context of DR. A model created by Bora et al. aimed to predict the development of DR within 2 years from baseline fundus photographs that did not contain any DR and achieved an AUC of 0.70 (95% CI 0.67–0.74) during external validation.53 Arcadu et al. used ETDRS 7-field CFPs from patients with DR at baseline to predict two-step worsening on the ETDRS severity scale at month 12, but their model only achieved a modest performance, with a mean AUC of 0.61.54

Glaucoma

Several studies trained DL models with CFPs to predict the onset of glaucoma. Both Thakur et al. and Lin et al. used CFPs to predict whether a person will develop glaucoma within a certain time frame in the future.55,56 While Thakur et al. reported moderate performance (AUC 0.88 [0.86–0.91] for onset in 1–3 years and AUC 0.77 [0.75–0.78] for onset in 4–7 years),55 the Multi-scale Multi-structure Siamese Network (MMSNet) developed by Lin et al. achieved an AUC of 0.93 for predicting onset of primary open-angle glaucoma in 2 years and AUC of 0.95 for predicting onset in 5 years.56

Hou et al. employed vision transformers, the cutting-edge DL architecture, to predict VF worsening using longitudinal OCT images and their most robust model achieved an AUC of 0.97 (95% CI 0.88–1.00).57 Similarly, Herbert et al. used vision transformers to predict rapid worsening in VF defects (more than 1 dB decrease per year globally) from OCT images, and their best-performing model had an AUC of 0.87 (95% CI 0.77–0.97).58

Clinical implications

Among the four kinds of prediction highlighted in our review, DL models capable of predicting disease onset and progression will likely have the most far-reaching impact on public health by identifying the most at-risk patients on a population level. In most medical conditions, early detection and timely initiation of treatment lead to better outcomes. For example, in nAMD, the presenting VA predicts the long-term VA. In glaucoma, optimal intraocular pressure control at the first sign of glaucomatous optic neuropathy can halt further damage. While being able to predict which patients will develop the earliest stage of diabetic eye disease (i.e. ETDRS level 20 [microaneurysms only]) does not affect DR management currently, as there is no approved therapy, this ability may become more relevant in future, should neuroprotective agents become available.

Treatment response prediction

Most studies published to date in this area pertain to predicting response to intravitreal anti-VEGF injections.

Age-related macular degeneration

Lee et al. trained a GAN with baseline OCT images and fundus fluorescein angiography/indocyanine green angiography images to generate post-therapeutic OCT images in patients undergoing anti-VEGF injections for nAMD.59 The synthetically generated images were compared with their authentic counterparts for the presence or absence of four biomarkers: pigment epithelial detachment, intraretinal fluid, subretinal fluid and subretinal hyper-reflective material. The best-performing model showed an accuracy ranging from 80.7% to 96.3% in generating the appropriate biomarkers in simulated post-therapeutic OCT images.59 Also Liu et al. used a GAN, trained with pairs of pre- and post-therapeutic OCT images of patients with nAMD, to predict treatment response.60 The synthetically generated OCT images were compared with actual post-therapeutic OCT images, and the generative DL model achieved an accuracy of 0.85 (95% CI 0.74–0.95) in predicting the final status of the macula (wet versus dry) and an accuracy of 0.81 (95% CI 0.69–0.93) in predicting whether there will be a complete resolution of sub/intraretinal fluid after one injection.60

Yeh et al. aimed to predict VA improvement at month 12 after the initiation of anti-VEGF injections.61 The model, HDF-Net, was trained with unsegmented baseline OCT images and non-image-based clinical data of treatment-naïve patients with nAMD and achieved an AUC of 0.98 (95% CI 0.97–0.99) in predicting VA improvement of ≥2 lines.61 Fu et al. used a least squares regression model to predict VA at 3 and 12 months after the initiation of anti-VEGF treatment. Their model achieved R2=0.80 (MAE 5.0 ETDRS letters) at month 3 and R2=0.7 (MAE 7.2 ETDRS letters) at month 12. In addition, the model was able to predict incremental VA change after the first and third injections.62 Romo-Bucheli et al. aimed to predict treatment burden over 2 years using baseline OCT images, and their model achieved an AUC of 0.81 in predicting high treatment burden, defined as ≥16 injections over 2 years.63

Diabetic retinopathy

Studies evaluating treatment response in DMO focused on predicting the reduction of macular thickness after anti-VEGF injections.64–66 Both Rasti et al. and Alryalat et al. used DL models to identify good responders versus poor responders based on OCT criteria, and the models developed by these two groups showed an AUC ranging from 0.81 to 0.86.64,65 Furthermore, Liu et al. used an ensemble model, comprising both DL and classical ML techniques, to predict post-treatment OCT CFT and VA using baseline OCT and clinical data. The MAE for predicting good anatomical outcome was 68.08 µm, and the MAE for predicting good functional outcome was 0.13 logMAR in the external validation dataset.66 Lastly, Xu et al. used a GAN to generate synthetic post-treatment OCT images that were compared with real post-treatment OCT images, and the MAE between synthetic and real images was 24.51 ± 18.56 μm for CFT.67

Clinical implications

The burden of VEGF-driven retinal diseases, such as AMD and DR, is expected to increase exponentially as the population ages and the incidence of diabetes continues to rise. Accordingly, the ability to risk stratify and tailor treatment plans for patients requiring anti-VEGF therapy will become increasingly important. On an individual level, more personalized therapy could lead to better final visual outcomes. On a systems level, given there is a large difference in cost between the different anti-VEGF agents, being able to determine which patients would respond equally well to both inexpensive and expensive medications would have implications from a cost-effectiveness point of view.

Conclusion and future directions

DL applications in ophthalmology have gradually shifted from classification to predictive tasks. Such predictive DL models hold the promise of revolutionizing our field by providing insights that may elude even the most astute clinicians. From a technical point of view, we anticipate the more widespread use of vision transformers and generative DL techniques in training these predictive models.

Structure-function predictions may involve the simultaneous correlation of multiple visual functional endpoints with a single imaging modality. Further, future studies involving the prospective validation of models trained with retrospective data will be invaluable. Finally, for predicting treatment response, clinical trials comparing standard-of-care versus DL-based clinical decision support tools will help establish whether DL tools could improve patient outcomes.

3

References

List View
Grid View
1
Copy DOIDOI Copied
Visit DOI Link

 Dick SArtificial intelligenceHarvard Data Sci Rev2019;1DOI10.1162/99608f92.92fe150c.

2
Copy DOIDOI Copied
Visit DOI Link

 Thompson ACJammal AAMedeiros FAA review of deep learning for screening, diagnosis, and detection of glaucoma progressionTransl Vis Sci Technol2020;9:42DOI10.1167/tvst.9.2.42.

3
Copy DOIDOI Copied
Visit DOI Link

 Ting DSWPasquale LRPeng Let alArtificial intelligence and deep learning in ophthalmologyBr J Ophthalmol2019;103:16775DOI10.1136/bjophthalmol-2018-313173.

4
Copy DOIDOI Copied
Visit DOI Link

 Rahimy EDeep learning applications in ophthalmologyCurr Opin Ophthalmol2018;29:25460. DOI10.1097/ICU.0000000000000470.

5
Copy DOIDOI Copied
Visit DOI Link

 Midena EFrizziero LTorresin Tet alOptical coherence tomography and color fundus photography in the screening of age-related macular degeneration: A comparative, population-based studyPLoS One. 2020;15:e0237352. DOI10.1371/journal.pone.0237352.

6
Copy DOIDOI Copied
Visit DOI Link

 Nanegrungsunk OPatikulsila DSadda SROphthalmic imaging in diabetic retinopathy: A reviewClin Exp Ophthalmol2022;50:108296DOI10.1111/ceo.14170.

7
Copy DOIDOI Copied
Visit DOI Link

 Anton ANolivos KPazos Met alDiagnostic accuracy and detection rate of glaucoma screening with optic disk photos, optical coherence tomography images, and telemedicineJ Clin Med2021;11:216DOI10.3390/jcm11010216.

8
Copy DOIDOI Copied
Visit DOI Link

 Wang YTTadarati MWolfson Yet alComparison of prevalence of diabetic macular edema based on monocular fundus photography vs optical coherence tomographyJAMA Ophthalmol2016;134:2228. DOI10.1001/jamaophthalmol.2015.5332.

9
Copy DOIDOI Copied
Visit DOI Link

 Arcadu FBenmansour FMaunz Aet alDeep learning predicts OCT measures of diabetic macular thickening from color fundus photographsInvest Ophthalmol Vis Sci2019;60:8527DOI10.1167/iovs.18-25634.

10
Copy DOIDOI Copied
Visit DOI Link

 Varadarajan AVBavishi PRuamviboonsuk Pet alPredicting optical coherence tomography-derived diabetic macular edema grades from fundus photographs using deep learningNat Commun2020;11:130DOI10.1038/s41467-019-13922-8.

11
Copy DOIDOI Copied
Visit DOI Link

 Medeiros FAJammal AAMariottoni EBDetection of progressive glaucomatous optic nerve damage on fundus photographs with deep learningOphthalmology2021;128:38392DOI10.1016/j.ophtha.2020.07.045.

12
Copy DOIDOI Copied
Visit DOI Link

 Lee JKim YKHa Aet alMacular ganglion cell-inner plexiform layer thickness prediction from red-free fundus photography using hybrid deep learning modelSci Rep2020;10:3280DOI10.1038/s41598-020-60277-y.

13
Copy DOIDOI Copied
Visit DOI Link

 Busbee BGHo ACBrown DMet alTwelve-month efficacy and safety of 0.5 mg or 2.0 mg ranibizumab in patients with subfoveal neovascular age-related macular degenerationOphthalmology2013;120:104656. DOI10.1016/j.ophtha.2012.10.014.

14
Copy DOIDOI Copied
Visit DOI Link

 Ho ACBusbee BGRegillo CDet alTwenty-four-month efficacy and safety of 0.5 mg or 2.0 mg ranibizumab in patients with subfoveal neovascular age-related macular degenerationOphthalmology2014;121:218192DOI10.1016/j.ophtha.2014.05.009.

15
Copy DOIDOI Copied
Visit DOI Link

 Kawczynski MGBengtsson TDai Jet alDevelopment of deep learning models to predict best-corrected visual acuity from optical coherence tomographyTransl Vis Sci Technol2020;9:51DOI10.1167/tvst.9.2.51.

16
Copy DOIDOI Copied
Visit DOI Link

 Balaskas KGlinton SKeenan TDLet alPrediction of visual function from automatically quantified optical coherence tomography biomarkers in patients with geographic atrophy using machine learningSci Rep. 2022;12:15565. DOI10.1038/s41598-022-19413-z.

17
Copy DOIDOI Copied
Visit DOI Link

 Oztürk FYavas GFKüsbeci TErmis SSA comparison among Humphrey field analyzer, Microperimetry, and Heidelberg Retina Tomograph in the evaluation of macula in primary open angle glaucomaJ Glaucoma. 2008;17:11821. DOI10.1097/IJG.0b013e31814b97fd.

18
Copy DOIDOI Copied
Visit DOI Link

 Scuderi LGattazzo Ide Paula Aet alUnderstanding the role of microperimetry in glaucomaInt Ophthalmol. 2022;42:2289301. DOI10.1007/s10792-021-02203-3.

19
Copy DOIDOI Copied
Visit DOI Link

 Midena EPilotto EMicroperimetry in age: Related macular degenerationEye (Lond)2017;31:98594. DOI10.1038/eye.2017.34.

20
Copy DOIDOI Copied
Visit DOI Link

 Yusuf IHJolly JKRatnarajan GSalmon JFMicroperimetry and optical coherence tomography imaging in the fellow eye of patients with unilateral focal ischaemic glaucomaEye (Lond)2018;32:13729DOI10.1038/s41433-018-0094-3.

21
Copy DOIDOI Copied
Visit DOI Link

 Safi HSafi SHafezi-Moghadam AAhmadieh HEarly detection of diabetic retinopathySurv Ophthalmol. 2018;63:6018. DOI10.1016/j.survophthal.2018.04.003.

22
Copy DOIDOI Copied
Visit DOI Link

 Seeböck PVogl W-DWaldstein SMet alLinking function and structure with resensnet: Predicting retinal sensitivity from OCT using deep learningOphthalmol Retina2022;6:50111DOI10.1016/j.oret.2022.01.021.

23
Copy DOIDOI Copied
Visit DOI Link

 Lin T-YChen H-RHuang H-Yet alDeep learning to infer visual acuity from optical coherence tomography in diabetic macular edemaFront Med (Lausanne)2022;9:1008950DOI10.3389/fmed.2022.1008950.

24
Copy DOIDOI Copied
Visit DOI Link

 Park KKim JLee JGrulkowski IA deep learning approach to predict visual field using optical coherence tomographyPLoS ONE2020;15:e0234902DOI10.1371/journal.pone.0234902.

25
Copy DOIDOI Copied
Visit DOI Link

 Park KKim JKim SShin JPrediction of visual field from swept-source optical coherence tomography using deep learning algorithmsGraefes Arch Clin Exp Ophthalmol2020;258:248999DOI10.1007/s00417-020-04909-z.

26
Copy DOIDOI Copied
Visit DOI Link

 Mariottoni EBDatta SDov Det alArtificial intelligence mapping of structure to function in glaucomaTransl Vis Sci Technol2020;9:19DOI10.1167/tvst.9.2.19.

27
Copy DOIDOI Copied
Visit DOI Link

 Datta SMariottoni EBDov Det alRetiNerveNet: Using recursive deep learning to estimate pointwise 24-2 visual field data based on retinal structureSci Rep2021;11:12562DOI10.1038/s41598-021-91493-9.

28
Copy DOIDOI Copied
Visit DOI Link

 Christopher MBowd CBelghith Aet alDeep learning approaches predict glaucomatous visual field damage from OCT optic nerve head en face images and retinal nerve fiber layer thickness maps. Ophthalmology. 2020;127:34656. DOI10.1016/j.ophtha.2019.09.036.

29
Copy DOIDOI Copied
Visit DOI Link

 Hemelings RElen BBarbosa-Breda Jet alPointwise visual field estimation from optical coherence tomography in glaucoma using deep learningTransl Vis Sci Technol2022;11:22DOI10.1167/tvst.11.8.22.

30
Copy DOIDOI Copied
Visit DOI Link

 Kihara YMontesano GChen Aet alMultimodal deep learning for predicting visual fields from the optic disc and OCT imagingOphthalmology2022;129:78191DOI10.1016/j.ophtha.2022.02.017.

31
Copy DOIDOI Copied
Visit DOI Link

 Hashimoto YAsaoka RKiwaki Tet alDeep learning model to predict visual field in central 10° from optical coherence tomography measurement in glaucomaBr J Ophthalmol2021;105:50713DOI10.1136/bjophthalmol-2019-315600.

32
Copy DOIDOI Copied
Visit DOI Link

 Hashimoto YKiwaki TSugiura Het alPredicting 10-2 visual field from optical coherence tomography in glaucoma using deep learning corrected with 24-2/30-2 visual fieldTransl Vis Sci Technol. 2021;10:28. DOI10.1167/tvst.10.13.28.

33
Copy DOIDOI Copied
Visit DOI Link

 Asano SAsaoka RMurata Het alPredicting the central 10 degrees visual field in glaucoma by applying a deep learning algorithm to optical coherence tomography imagesSci Rep2021;11:2214DOI10.1038/s41598-020-79494-6.

34
Copy DOIDOI Copied
Visit DOI Link

 Xu LAsaoka RKiwaki Tet alPredicting the glaucomatous central 10-degree visual field from optical coherence tomography using deep learning and tensor regressionAm J Ophthalmol2020;218:30413. DOI10.1016/j.ajo.2020.04.037.

35
Copy DOIDOI Copied
Visit DOI Link

 Moon SLee JHChoi Het alDeep learning approaches to predict 10-2 visual field from wide-field swept-source optical coherence tomography en face images in glaucomaSci Rep2022;12:21041DOI10.1038/s41598-022-25660-x.

36
Copy DOIDOI Copied
Visit DOI Link

 Christopher MBowd CProudfoot JAet alDeep learning estimation of 10-2 and 24-2 visual field metrics based on thickness maps from macula OCTOphthalmology2021;128:153448DOI10.1016/j.ophtha.2021.04.022.

37
Copy DOIDOI Copied
Visit DOI Link

 Shamsi FLiu ROwsley CKwon MIdentifying the retinal layers linked to human contrast sensitivity via deep learningInvest Ophthalmol Vis Sci2022;63:27DOI10.1167/iovs.63.2.27.

38
Copy DOIDOI Copied
Visit DOI Link

 Russakoff DBLamin AOakley JDet alDeep learning for prediction of AMD progression: A pilot studyInvest Ophthalmol Vis Sci2019;60:71222DOI10.1167/iovs.18-25325.

39
Copy DOIDOI Copied
Visit DOI Link

 Yim JChopra RSpitz Tet alPredicting conversion to wet age-related macular degeneration using deep learningNat Med2020;26:8929DOI10.1038/s41591-020-0867-7.

40
Copy DOIDOI Copied
Visit DOI Link

 Banerjee Ide Sisternes LHallak JAet alPrediction of age-related macular degeneration disease using a sequential deep learning approach on longitudinal SD-OCT imaging biomarkersSci Rep. 2020;10:15434. DOI10.1038/s41598-020-72359-y.

41
Copy DOIDOI Copied
Visit DOI Link

 Age-Related Eye Disease Study Research GroupThe age-related eye disease study (AREDS): Design implicationsAREDS report no1Control Clin Trials1999;20:573600.

42
Copy DOIDOI Copied
Visit DOI Link

 Chew EYClemons Tet alARThe Age-Related Eye Disease Study 2 (ARED2): Study design and baseline characteristics (AREDS2 report number 1)Ophthalmology2012;119:22829DOI10.1016/j.ophtha.2012.05.027.

43
Copy DOIDOI Copied
Visit DOI Link

 Bhuiyan AWong TYTing DSWet alArtificial intelligence to stratify severity of age-related macular degeneration (AMD) and predict risk of progression to late AMDTransl Vis Sci Technol2020;9:25DOI10.1167/tvst.9.2.25.

44
Copy DOIDOI Copied
Visit DOI Link

 Peng YKeenan TDChen Qet alPredicting risk of late age-related macular degeneration using deep learningNPJ Digit Med2020;3:111DOI10.1038/s41746-020-00317-z.

45
Copy DOIDOI Copied
Visit DOI Link

 Ganjdanesh AZhang JChew EYet alLONGL-Net: temporal correlation structure guided deep learning model to predict longitudinal age-related macular degeneration severityPNAS Nexus. 2022;1:pgab003. DOI10.1093/pnasnexus/pgab003.

46
Copy DOIDOI Copied
Visit DOI Link

 Liefers BColijn JMGonzález-Gonzalo Cet alA deep learning model for segmentation of geographic atrophy to study its long-term natural historyOphthalmology2020;127:108696DOI10.1016/j.ophtha.2020.02.009.

47
Copy DOIDOI Copied
Visit DOI Link

 Mitchell PSmith WAttebo KWang JJPrevalence of age-related maculopathy in Australia. The Blue Mountains Eye StudyOphthalmology1995;10:9097791.

48
Copy DOIDOI Copied
Visit DOI Link

 Ikram MABrusselle GGOMurad SDet alThe Rotterdam Study: 2018 update on objectives, design and main resultsEur J Epidemiol2017;32:80750DOI10.1007/s10654-017-0321-4.

49
Copy DOIDOI Copied
Visit DOI Link

 Gigon AMosinska AMontesel Aet alPersonalized atrophy risk mapping in age-related macular degenerationTransl Vis Sci Technol2021;10:18DOI10.1167/tvst.10.13.18.

50
Copy DOIDOI Copied
Visit DOI Link

 Zhang YZhang XJi Zet alAn integrated time adaptive geographic atrophy prediction model for SD-OCT imagesMed Image Anal2021;68:101893DOI10.1016/j.media.2020.101893.

51
Copy DOIDOI Copied
Visit DOI Link

 Anegondi NGao SSSteffen Vet alDeep learning to predict geographic atrophy area and growth rate from multimodal imagingOphthalmol Retina2023;7:24352DOI10.1016/j.oret.2022.08.018.

52
Copy DOIDOI Copied
Visit DOI Link

 Kalra GCetin HWhitney Jet alAutomated identification and segmentation of Ellipsoid Zone At-Risk using deep learning on SD-OCT for predicting progression in dry AMDDiagnostics2023;13:1178DOI10.3390/diagnostics13061178.

53
Copy DOIDOI Copied
Visit DOI Link

 Bora ABalasubramanian SBabenko Bet alPredicting the risk of developing diabetic retinopathy using deep learningLancet Digit Health2021;3:e109DOI10.1016/S2589-7500(20)30250-8.

54
Copy DOIDOI Copied
Visit DOI Link

 Arcadu FBenmansour FMaunz Aet alDeep learning algorithm predicts diabetic retinopathy progression in individual patientsNPJ Digit Med2019;2:92DOI10.1038/s41746-019-0172-3.

55
Copy DOIDOI Copied
Visit DOI Link

 Thakur AGoldbaum MYousefi SPredicting glaucoma before onset using deep learningOphthalmol Glaucoma2020;3:2628DOI10.1016/j.ogla.2020.04.012.

56
Copy DOIDOI Copied
Visit DOI Link

 Lin MLiu LGorden Met alMulti-scale Multi-structure Siamese Network (MMSNet) for primary open-angle glaucoma predictionMach Learn Med Imaging2022;13583:43645DOI10.1007/978-3-031-21014-3_45.

57
Copy DOIDOI Copied
Visit DOI Link

 Hou KBradley CHerbert Pet alPredicting visual field worsening with longitudinal OCT data using a gated transformer networkOphthalmology2023;130:85462DOI10.1016/j.ophtha.2023.03.019.

58
Copy DOIDOI Copied
Visit DOI Link

 Herbert PHou KBradley Cet alForecasting risk of future rapid glaucoma worsening using early visual field, OCT, and clinical dataOphthalmol Glaucoma2023;6:46673DOI10.1016/j.ogla.2023.03.005.

59
Copy DOIDOI Copied
Visit DOI Link

 Lee HKim SKim MAet alPost-treatment prediction of optical coherence tomography using a conditional generative adversarial network in age-related macular degenerationRetina2021;41:57280. DOI10.1097/IAE.0000000000002898.

60
Copy DOIDOI Copied
Visit DOI Link

 Liu YYang JZhou Yet alPrediction of OCT images of short-term response to anti-VEGF treatment for neovascular age-related macular degeneration using generative adversarial networkBr J Ophthalmol. 2020;104:173540. DOI10.1136/bjophthalmol-2019-315338.

61
Copy DOIDOI Copied
Visit DOI Link

 Yeh T-CLuo A-CDeng Y-Set alPrediction of treatment outcome in neovascular age-related macular degeneration using a novel convolutional neural networkSci Rep2022;12:5871DOI10.1038/s41598-022-09642-7.

62
Copy DOIDOI Copied
Visit DOI Link

 Fu DJFaes LWagner SKet alPredicting incremental and future visual change in neovascular age-related macular degeneration using deep learningOphthalmol Retina2021;5:107484DOI10.1016/j.oret.2021.01.009.

63
Copy DOIDOI Copied
Visit DOI Link

 Romo-Bucheli DErfurth USBogunovic HEnd-to-end deep learning model for predicting treatment requirements in neovascular AMD from longitudinal retinal OCT imagingIEEE J Biomed Health Inform2020;24:345665. DOI10.1109/JBHI.2020.3000136.

64
Copy DOIDOI Copied
Visit DOI Link

 Rasti RAllingham MJMettu PSet alDeep learning-based single-shot prediction of differential effects of anti-VEGF treatment in patients with diabetic macular edemaBiomed Opt Express2020;11:113952. DOI10.1364/BOE.379150.

65
Copy DOIDOI Copied
Visit DOI Link

 Alryalat SAAl-Antary MArafa Yet alDeep learning prediction of response to anti-VEGF among diabetic macular edema patients: Treatment Response Analyzer System (TRAS)Diagnostics (Basel). 2022;32:312. DOI10.3390/diagnostics12020312.

66
Copy DOIDOI Copied
Visit DOI Link

 Liu BZhang BHu Yet alAutomatic prediction of treatment outcomes in patients with diabetic macular edema using ensemble machine learningAnn Transl Med2021;9:4343DOI10.21037/atm-20-1431.

67
Copy DOIDOI Copied
Visit DOI Link

 Xu FLiu SXiang Yet alPrediction of the short-term therapeutic effect of anti-VEGF therapy for diabetic macular edema using a generative adversarial network with OCT imagesJ Clin Med2022;11:2878DOI10.3390/jcm11102878.

4

Article Information

Disclosure

TY Alvin Liu has received funding support for his salary from Research to Prevent Blindness Career Development Award. Neslihan Dilruba Koseoglu has no financial or non-financial relationships or activities to declare in relation to this article.

Compliance With Ethics

This article involves a review of the literature and did not involve any studies with human or animal subjects performed by any of the authors.

Review Process

Double-blind peer review.

Authorship

The named authors meet the International Committee of Medical Journal Editors (ICMJE) criteria for authorship of this manuscript, take responsibility for the integrity of the work as a whole, and have given final approval for the version to be published.

Correspondence

TY Alvin Liu600 N. Wolfe St, Maumenee 726Baltimore, MD 21287USAtliu25@jhmi.edu

Support

No funding was received in the publication of this article.

Access

This article is freely accessible at touchOPHTHALMOLOGY.com © Touch Medical Media 2023.

Data Availability

Data sharing is not applicable to this article as no datasets were generated or analysed during the writing of this article.

Received

2023-05-29

5

Further Resources

Share
Facebook
X (formerly Twitter)
LinkedIn
Via Email
Mark CompleteCompleted
BookmarkBookmarked
Copy LinkLink Copied
Download as PDF

This Functionality is for
Members Only

Explore the latest in medical education and stay current in your field. Create a free account to track your learning.

Close Popup