EducationMedical telementoring using an augmented reality transparent display
Section snippets
System description
STAR provides the trainee with an augmented “window” through which the trainee views the operating field while completing the operation. The following discussion describes the design and architecture of STAR and the subsystems (the trainee subsystem and the mentor subsystem) through which the trainee and mentor interact to complete a telementored operation.
Fig 1 shows the trainee subsystem. The tablet captures and displays live video of the operating field using its camera. When the trainee
Methods
Our study was conducted with 17 premedical and 3 medical students at Purdue University. Each participant completed 2 simulated tasks: placement of an incision for port placement and an abdominal incision. In each task, participants acted as a trainee in a telementoring scenario with a simulated mentor providing incremental graphic annotations as the participant completed each stage of the task. Ten students used the STAR surgical telementoring system, and the other 10 students used a
Placement error
For the task of port placement, placement error for participants using STAR (median, 23.73; IQR, 13.28 px) and the conventional system (median, 57.55; IQR, 32.80 px) was different (P < .001) with a median improvement of 33.8 px, representing a 59% decrease. Likewise, there was a 68% improvement (P < .001) decreasing 49.5 px in average the placement error for the abdominal incision task, from the conventional system (μ, 72.6; σx, 16.9 px) to STAR (μ, 23.1; σx, 8.4 px).
Focus shifts
For the port placement
Placement error
In each task, participants using STAR completed the task with significantly less placement error than participants using the conventional system. One likely cause for the decrease in placement error is the direct overlay of annotations onto the operating field. When using STAR, trainees avoided the cognitive load involved in looking at a separate image of the operating field, interpreting it, and mapping the separate instructions onto the actual operating field.
Operations rely on a sequence of
References (14)
- et al.
Changing demographics of residents choosing fellowships: longterm data from the American Board of Surgery
J Am Coll Surg
(2008) - et al.
Live transference of surgical subspecialty skills using telerobotic proctoring to remote general surgeons
J Am Coll Surg
(2010) - et al.
A gesture-based tool for sterile browsing of radiology images
J Am Med Inform Assoc
(2008) - et al.
Telementoring: a multi-institutional experience with the introduction of a novel surgical approach for adrenalectomy
Ann Surg Oncol
(2013) Telemedicine for the battlefield: present and future technologies
Surgical Robotics
(2011)- et al.
An evaluation framework for defining the contributions of telestration in surgical telementoring
Interact J Med Res
(2013) - et al.
Hand gesture-based sterile interface for the operating room using contextual cues for the navigation of radiological images
J Am Med Inform Assoc
(2013)
Cited by (65)
Virtual reality and augmented reality in radiation oncology education – A review and expert commentary
2022, Technical Innovations and Patient Support in Radiation OncologyPrivacy-protection system using a unidirectional emission waveguide liquid crystal display and an asymmetrical transmission window system
2022, Optics and Lasers in EngineeringCitation Excerpt :Transparent displays, also known as see-through displays, have been widely developed in recent decades. People can view scenes behind transparent displays, and thus, they are extensively applied to several fields, such as augmented reality, medical uses, and so on [1–6]. A transparent organic light-emitting diode (T-OLED) display is one of the potential candidates to realize transparent displays [7–11].
How does telementoring impact medical education within the surgical field? A scoping review
2022, American Journal of SurgeryTelestration in the Teaching of Basic Surgical Skills: A Randomized Trial
2022, Journal of Surgical EducationAugmented reality self-training system for suturing in open surgery: A randomized controlled trial
2022, International Journal of SurgeryAR/MR Remote Collaboration on Physical Tasks: A Review
2021, Robotics and Computer-Integrated Manufacturing
Sources of Funding: Supported by the Office of the Assistant Secretary of Defense for Health Affairs under Award No. W81XWH-14-1-0042.