ON THE EFFECT OF VIRTUAL REALITY ON STUDENT UNDERSTANDING OF AND INTEREST IN PHYSICS

This study investigated the effect that the video game Portal 2 had on students understanding of Newton’s Laws and their attitudes towards learning science during a two-week afterschool program at a science museum. Using a pre/posttest and survey design, along with instructor observations, the results showed a statistically relevant increase in understanding of Newton’s Laws (p=.02<.05) but did not measure a relevant change in attitude scores. The data and observations suggest that future research should pay attention to non-educational aspects of video games, be careful about the amount of time students spend in the game, and encourage positive relationships with game developers.

Virtual reality ultrasound imaging of the normal and abnormal fetal central nervous system

OBJECTIVES: In fetal ultrasound imaging, teaching and experience are of paramount importance to improve prenatal detection rates of fetal abnormalities. Yet both aspects depend on exposure to normal and, in particular, abnormal 'specimens'. We aimed to generate a number of simple virtual reality (VR) objects of the fetal central nervous system for use as educational tools. METHODS: We applied a recently proposed algorithm for the generation of fetal VR object movies to the normal and abnormal fetal brain and spine. Interactive VR object movies were generated from ultrasound volume data from normal fetuses and fetuses with typical brain or spine anomalies. Pathognomonic still images from all object movies were selected and annotated to enable recognition of these features in the object movies. RESULTS: Forty-six virtual reality object movies from 22 fetuses (two with normal and 20 with abnormal brains) were generated in an interactive display format (QuickTime) and key images were annotated. The resulting .mov files are available for download from the website of this journal. CONCLUSIONS: VR object movies can be generated from educational ultrasound volume datasets, and may prove useful for teaching and learning normal and abnormal fetal anatomy.

Landmark-based augmented reality system for paranasal and transnasal endoscopic surgeries

BACKGROUND: In this paper we present a landmark-based augmented reality (AR) endoscope system for endoscopic paranasal and transnasal surgeries along with fast and automatic calibration and registration procedures for the endoscope. METHODS: Preoperatively the surgeon selects natural landmarks or can define new landmarks in CT volume. These landmarks are overlaid, after proper registration of preoperative CT to the patient, on the endoscopic video stream. The specified name of the landmark, along with selected colour and its distance from the endoscope tip, is also augmented. The endoscope optics are calibrated and registered by fast and automatic methods. Accuracy of the system is evaluated in a metallic grid and cadaver set-up. RESULTS: Root mean square (RMS) error of the system is 0.8 mm in a controlled laboratory set-up (metallic grid) and was 2.25 mm during cadaver studies. CONCLUSIONS: A novel landmark-based AR endoscope system is implemented and its accuracy is evaluated. Augmented landmarks will help the surgeon to orientate and navigate the surgical field. Studies prove the capability of the system for the proposed application. Further clinical studies are planned in near future.

Video Composer and Live Video Conductor: Future Professions for the Interactive Digital Broadcasting Industry

Innovations in hardware and network technologies lead to an exploding number of non-interrelated parallel media streams. Per se this does not mean any additional value for consumers. Broadcasting and advertisement industries have not yet found new formats to reach the individual user with their content. In this work we propose and describe a novel digital broadcasting framework, which allows for the live staging of (mass) media events and improved consumer personalisation. In addition new professions for future TV production workflows which will emerge are described, namely the 'video composer' and the 'live video conductor'.

Semi-Automated Creation of Converged iTV Services: From Macromedia Director Simulations to Services Ready for Broadcast

While sound and video may capture viewers' attention, interaction can captivate them. This has not been available prior to the advent of Digital Television. In fact, what lies at the heart of the Digital Television revolution is this new type of interactive content, offered in the form of interactive Television (iTV) services. On top of that, the new world of converged networks has created a demand for a new type of converged services on a range of mobile terminals (Tablet PCs, PDAs and mobile phones). This paper aims at presenting a new approach to service creation that allows for the semi-automatic translation of simulations and rapid prototypes created in the accessible desktop multimedia authoring package Macromedia Director into services ready for broadcast. This is achieved by a series of tools that de-skill and speed-up the process of creating digital TV user interfaces (UI) and applications for mobile terminals. The benefits of rapid prototyping are essential for the production of these new types of services, and are therefore discussed in the first section of this paper. In the following sections, an overview of the operation of content, service, creation and management sub-systems is presented, which illustrates why these tools compose an important and integral part of a system responsible of creating, delivering and managing converged broadcast and telecommunications services. The next section examines a number of metadata languages candidates for describing the iTV services user interface and the schema language adopted in this project. A detailed description of the operation of the two tools is provided to offer an insight of how they can be used to de-skill and speed-up the process of creating digital TV user interfaces and applications for mobile terminals. Finally, representative broadcast oriented and telecommunication oriented converged service components are also introduced, demonstrating how these tools have been used to generate different types of services.

Methods and Applications in Interactive Broadcasting

Interactive TV technology has been addressed in many previous works, but there is sparse research on the topic of interactive content broadcasting and how to support the production process. In this article, the interactive broadcasting process is broadly defined to include studio technology and digital TV applications at consumer set-top boxes. In particular, augmented reality studio technology employs smart-projectors as light sources and blends real scenes with interactive computer graphics that are controlled at end-user terminals. Moreover, TV producer-friendly multimedia authoring tools empower the development of novel TV formats. Finally, the support for user-contributed content raises the potential to revolutionize the hierarchical TV production process, by introducing the viewer as part of content delivery chain.

Exploiting OSGi capabilities from MHP applications

In this paper we introduce a cooperative environment between the Interactive Digital TV (IDTV) and home networking with the aim of allowing the interaction between interactive TV applications and the controllers of the in-home appliances in a natural way. More specifically, our proposal consists of merging MHP (Multimedia Home Platform), one of the main standard frameworks for IDTV, with OSGi (Open Service Gateway Initiative), the most widely used open platform to set up Residential Gateways. To overcome the radically different nature of these specifications the function-oriented MHP middleware and the service-oriented OSGi framework , we define a new kind of application, coined as XbundLET. Although this software bridge is suitable to enable the interaction between MHP and OSGi applications in both directions, we concretely focus on exposing our implementation experience in only one direction: from MHP to the OSGi world.