Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy

PURPOSE: The aim of this study is to implement augmented reality in real-time image-guided interstitial brachytherapy to allow an intuitive real-time intraoperative orientation. METHODS AND MATERIALS: The developed system consists of a common video projector, two high-resolution charge coupled device cameras, and an off-the-shelf notebook. The projector was used as a scanning device by projecting coded-light patterns to register the patient and superimpose the operating field with planning data and additional information in arbitrary colors. Subsequent movements of the nonfixed patient were detected by means of stereoscopically tracking passive markers attached to the patient. RESULTS: In a first clinical study, we evaluated the whole process chain from image acquisition to data projection and determined overall accuracy with 10 patients undergoing implantation. The described method enabled the surgeon to visualize planning data on top of any preoperatively segmented and triangulated surface (skin) with direct line of sight during the operation. Furthermore, the tracking system allowed dynamic adjustment of the data to the patient's current position and therefore eliminated the need for rigid fixation. Because of soft-part displacement, we obtained an average deviation of 1.1 mm by moving the patient, whereas changing the projector's position resulted in an average deviation of 0.9 mm. Mean deviation of all needles of an implant was 1.4 mm (range, 0.3-2.7 mm). CONCLUSIONS: The developed low-cost augmented-reality system proved to be accurate and feasible in interstitial brachytherapy. The system meets clinical demands and enables intuitive real-time intraoperative orientation and monitoring of needle implantation.

Is virtuality close enough to reality? A comparison of the effectiveness of simulations with traditional laboratory activities in a high school biology class

Some schools do not have ideal access to laboratory space and supplies. Computer simulations of laboratory activities can be a cost-effective way of presenting experiences to students, but are those simulations as effective at supplementing content concepts? This study compared the use of traditional lab activities illustrating the principles of cell respiration and photosynthesis in an introductory high school biology class with virtual simulations of the same activities. Additionally student results were analyzed to assess if student conceptual understanding was affected by the complexity of the simulation. Although all student groups posted average gain increases between the pre and post-tests coupled with positive effect sizes, students who completed the wet lab version of the activity consistently outperformed the students who completed the virtual simulation of the same activity. There was no significant difference between the use of more or less complex simulations. Students also tended to rate the wet lab experience higher on a motivation and interest inventory.

Augmented reality endoscopic system (ARES): preliminary results

During endoscopic surgery, it is difficult to ascertain the anatomical landmarks once the anatomy is fiddled with or if the operating area is filled with blood. An augmented reality system will enhance the endoscopic view and further enable surgeons to view hidden critical structures or the results of preoperative planning.

Simple virtual reality display of fetal volume ultrasound

Three-dimensional (3D) ultrasound volume acquisition, analysis and display of fetal structures have enhanced their visualization and greatly improved the general understanding of their anatomy and pathology. The dynamic display of volume data generally depends on proprietary software, usually supplied with the ultrasound system, and on the operator's ability to maneuver the dataset digitally. We have used relatively simple tools and an established storage, display and manipulation format to generate non-linear virtual reality object movies of prenatal images (including moving sequences and 3D-rendered views) that can be navigated easily and interactively on any current computer. This approach permits a viewing or learning experience that is superior to watching a linear movie passively.

Dopamine inhibition and the adaptation of behavior to ongoing reality

Spontaneous confabulation is a rare memory disorder resulting from orbitofrontal damage or disconnection. Patients act on the basis of memories that do not pertain to the current situation, and are disoriented. No medical treatment is known. Recent studies suggest that subcortical dopaminergic structures are involved in the selection of currently relevant memories. We present a patient who regained the ability to adapt thought and behavior to ongoing reality when treated with risperidone, a dopamine antagonist.

ON THE EFFECT OF VIRTUAL REALITY ON STUDENT UNDERSTANDING OF AND INTEREST IN PHYSICS

This study investigated the effect that the video game Portal 2 had on students understanding of Newton’s Laws and their attitudes towards learning science during a two-week afterschool program at a science museum. Using a pre/posttest and survey design, along with instructor observations, the results showed a statistically relevant increase in understanding of Newton’s Laws (p=.02<.05) but did not measure a relevant change in attitude scores. The data and observations suggest that future research should pay attention to non-educational aspects of video games, be careful about the amount of time students spend in the game, and encourage positive relationships with game developers.