Key messages
We did not find enough evidence to show that virtual reality (VR) training improves cataract surgery performance among ophthalmology trainees compared to wet lab or conventional training.
What is virtual reality training?
VR training uses computer technology to simulate a three-dimensional interactive environment.
How does cataract surgery training work in ophthalmology trainees?
Most postgraduate ophthalmology trainees in the United States (US) transition gradually from performing specific cataract surgery (replacing the cloudy lens inside the eye with an artificial one) steps in a wet laboratory (practicing on cadaver or artificial tissues) or using VR simulators to performing cataract surgery in the operating room.
Why is this question important?
VR training is becoming increasingly common in postgraduate ophthalmology training, but comprehensive reviews of the impact of VR training on trainees’ cataract surgery performance are lacking.
What did we want to find out?
The primary aim of this review was to determine whether VR training improved operating room performance (measured by operating time in the operating room, intraoperative [during the operation] complications, or postoperative [after the operation] complications) in cataract surgery for postgraduate ophthalmology trainees. The secondary aim was to identify the impact of VR training on operating time in simulated settings, supervising physician ratings in the operating room or simulator settings, or VR simulation task ratings.
How did we identify and evaluate the evidence?
We searched for studies that compared VR training to other training methods such as traditional wet laboratory training or no supplementary training in a postgraduate ophthalmology trainee population.
What did we find?
VR relative to conventional or wet laboratory training did not impact operating times, the rate of intraoperative complications, or supervising physician ratings in the operating room. However, compared to trainees without supplementary training, VR-trained trainees received higher supervising physician ratings in the operating room. The quality of evidence for all outcomes was very low.
What does this mean?
VR training is a promising intervention for teaching cataract surgery, but more rigorous, evidence-based studies are needed to gauge its impact on key outcomes such as intraoperative and postoperative complications.
How up-to-date is the evidence?
The evidence is current up to 14 June 2021.
Current research suggests that VR training may be more effective than no supplementary training in improving trainee performance in the operating room and simulated settings for postgraduate ophthalmology trainees, but the evidence is uncertain. The evidence comparing VR with conventional or wet laboratory training was less consistent.
Cataract surgery is the most common incisional surgical procedure in ophthalmology and is important in ophthalmic graduate medical education. Although most ophthalmology training programs in the United States (US) include virtual reality (VR) training for cataract surgery, comprehensive reviews that detail the impact of VR training on ophthalmology trainee performance are lacking.
To assess the impact of VR training for cataract surgery on the operating performance of postgraduate ophthalmology trainees, measured by operating time, intraoperative complications, postoperative complications, supervising physician ratings, and VR simulator task ratings.
We searched CENTRAL (which contains the Cochrane Eyes and Vision Trials Register), Ovid MEDLINE, Embase.com, PubMed, LILACS, ClinicalTrials.gov, and the World Health Organization (WHO) International Clinical Trials Registry Platform (ICTRP). We did not use any date or language restrictions in the electronic search for trials. We last searched the electronic databases on 14 June 2021.
We included randomized controlled trials (RCTs) comparing VR training to any other method of training, including non-VR simulation training (e.g., wet laboratory training), didactics training, or no supplementary training in postgraduate ophthalmology trainees.
We used standard Cochrane methodology. Primary outcomes were operating times in the operating room and intraoperative complications. Secondary outcomes were operating times in simulated settings, simulator task ratings, and supervising physician ratings, either in the operating room or simulated settings.
We included six RCTs with a total of 151 postgraduate ophthalmology trainees ranging from 12 to 60 participants in each study. The included studies varied widely in terms of geography: two in the US, and one study each in China, Germany, India, and Morocco. Three studies compared VR training for phacoemulsification cataract surgery on the Eyesi simulator (VRmagic, Mannheim, Germany) with wet laboratory training and two studies compared VR training with no supplementary training. One study compared trainees who received VR training with those who received conventional training for manual small incision cataract surgery on the HelpMeSee simulator (HelpMeSee, New York, NY). Industry financially supported two studies. All studies had at least three domains judged at high or unclear risks of bias. We did not conduct a meta-analysis due to insufficient data (i.e., lack of precision measurements, or studies reported only P values). All evidence was very low-certainty, meaning that any estimates were unreliable.
The evidence for the benefits of VR training for trainees was very uncertain for primary outcomes. VR-trained trainees relative to those without supplementary training had shorter operating times (mean difference [MD] −17 minutes, 95% confidence interval [CI] −21.62 to −12.38; 1 study, n = 12; very low-certainty evidence). Results for operating time were inconsistent when comparing VR and wet laboratory training: one study found that VR relative to wet laboratory training was associated with longer operating times (P = 0.038); the other reported that two training groups had similar operating times (P = 0.14). One study reported that VR-trained trainees relative to those without supplementary training had fewer intraoperative complications (P < 0.001); in another study, VR and conventionally trained trainees had similar intraoperative complication rates (MD −8.31, 95% CI −22.78 to 6.16; 1 study, n = 19; very low-certainty evidence).
For secondary outcomes, VR training may have similar impact on trainee performance compared to wet laboratory and greater impact compared to no supplementary training, but the evidence was very uncertain. One study reported VR-trained trainees relative to those without supplementary training had significantly reduced operating time in simulated settings (P = 0.0013). Another study reported that VR-trained relative to wet laboratory-trained trainees had shorter operating times in VR settings (MD −1.40 minutes, 95% CI −1.96 to −0.84; 1 study, n = 60) and similar times in wet laboratory settings (MD 0.16 minutes, 95% CI −0.50 to 0.82; 1 study, n = 60). This study also found the VR-trained trainees had higher VR simulator ratings (MD 5.17, 95% CI 0.61 to 9.73; 1 study, n = 60). Results for supervising physician ratings in the operating room were inconsistent: one study reported that VR- and wet laboratory-trained trainees received similar supervising physician ratings for cataract surgery (P = 0.608); another study reported that VR-trained trainees relative to those without supplementary training were less likely to receive poor ratings by supervising physicians for capsulorhexis construction (RR 0.29, 95% CI 0.15 to 0.57). In wet laboratory settings, VR-trained trainees received similar supervising physician ratings compared with wet laboratory-trained trainees (MD −1.50, 95% CI −6.77 to 3.77; n = 60) and higher supervising physician ratings compared with trainees without supplementary training (P < 0.0001). However, the results for all secondary outcomes should be interpreted with caution because of very low-certainty evidence.