Haptic virtual reality training environment for micro-robotic cell injection

Micro-robotic cell injection is typically performed manually by a trainedbio-operator, and success rates are often low. To enhance bio-operator performance during real-time cell injection, our earlier work introduced a haptically-enabled micro-robotic cell injection system. The system employed haptic virtual fixtures to provide haptic guidance according to articular performance metrics. This paper extends the work by replicating the system within a virtual reality (VR) environment for bio-operator training. Using the virtual environment, the bio-operator is able to control the virtual injection process in the same way they would with the physical haptic micro-robotic cell injection system, while benefiting from the enhanced visualisation capabilities offered by the 3D VR environment. The system is achieved using cost-effective components offering training at much lower cost than using the physical system.

Keyboard control method for virtual reality micro-robotic cell injection training

The rapid development of virtual reality offers significant potential for skills training applications. Our ongoing work proposes virtual reality operator training for the micro-robotic cell injection procedure. The interface between the operator and the system can be achieved in many different ways. The computer keyboard is ubiquitous in its use for everyday computing applications and also commonly utilized in virtual reality systems. Based on the premise that most people have experience in using a computer keyboard, as opposed to more sophisticated input devices, this paper considers the feasibility of using a keyboard to control the micro-robot for cell injection. In this study, thirteen participants underwent the experimental evaluation. The participants were asked to perform three simulated trial sessions in a virtual micro-robotic cell injection environment. Each session consisted of ten cell injection trials and relevant data for each trial were recorded and analyzed. Results showed participants' performance improvement after the three sessions. It was also observed that participants intuitively controlled multiple axes of the micro-robot simultaneously despite the absence of instruction on how to do so. This continued throughout the experiments and suggests skills transfer from other keyboard based interactions. Based on the results provided, it is suggested that keyboard control is a feasible, simple and low-cost control method for the virtual micro-robot.

Design of a virtual reality training system for micro-robotic cell injection

This paper discusses the design of a virtual reality (VR) training system for micro-robotic cell injection. A brief explanation of cell injection and the challenges associated with the procedure are first presented. This is followed by discussion of the skills required by the bio-operator to achieve successful injection, such as accuracy, trajectory and applied force. The design of the VR system which includes the visual display, input controllers, mapping strategies, haptic guidance and output data is then discussed. Initial evaluation of the VR system is presented including analysis and discussion based on conducted user evaluations. Finally, given the findings of the initial evaluation, this paper concludes that an effective haptically-enabled virtual cell injection training system is feasible, and recommendations for improvement and future work are given.

Building the computational virtual reality environment for anaesthetists' training and practice

Understanding the real world based on visualisation and prediction is essential for the decision-maker. We build a computational virtual reality environment to improve visualisation, understanding and prediction of the physical world and to guide action. It develops a five-dimensional, computer-generated, computational Virtual Reality Environment for Anaesthesia (VREA). Our online prediction will be calculated based on the correlation and composition computing with respect to the three dimensions: horizontal, vertical and individual. The novel musical notes based anesthetic simulator is proposed to identify the abnormality and visualize the online medical time series. The experiments with the online ECG data will present a real-time case to show the effectiveness and efficiency of our proposed system and algorithms.

Building computational virtual reality environment for anesthesia

In this paper, a Computational Virtual Reality Environment for Anesthesia (CVREA) is proposed. Virtual reality, data mining, machine learning techniques will be explored to develop (1) an immersive and interactive training platform for anaesthetists, which can greatly improve their training and learning performance; (2) a knowledge learning environment which collects clinical data with greater richness, process data with more efficacy, and facilitate knowledge discovery in anaesthesiology.

Use of active video games to increase physical activity in children: a (virtual) reality?

There has been increased research interest in the use of active video games (in which players physically interact with images onscreen) as a means to promote physical activity in children. The aim of this review was to assess active video games as a means of increasing energy expenditure and physical activity behavior in children. Studies were obtained from computerized searches of multiple electronic bibliographic databases. The last search was conducted in December 2008. Eleven studies focused on the quantification of the energy cost associated with playing active video games, and eight studies focused on the utility of active video games as an intervention to increase physical activity in children. Compared with traditional nonactive video games, active video games elicited greater energy expenditure, which was similar in intensity to mild to moderate intensity physical activity. The intervention studies indicate that active video games may have the potential to increase free-living physical activity and improve body composition in children; however, methodological limitations prevent definitive conclusions. Future research should focus on larger, methodologically sound intervention trials to provide definitive answers as to whether this technology is effective in promoting long-term physical activity in children.

Does a combination of virtual reality, neuromodulation and neuroimaging provide a comprehensive platform for neurorehabilitation? - A narrative review of the literature

In the last decade, virtual reality (VR) training has been used extensively in video games and military training to provide a sense of realism and environmental interaction to its users. More recently, VR training has been explored as a possible adjunct therapy for people with motor and mental health dysfunctions. The concept underlying VR therapy as a treatment for motor and cognitive dysfunction is to improve neuroplasticity of the brain by engaging users in multisensory training. In this review, we discuss the theoretical framework underlying the use of VR as a therapeutic intervention for neurorehabilitation and provide evidence for its use in treating motor and mental disorders such as cerebral palsy, Parkinson’s disease, stroke, schizophrenia, anxiety disorders, and other related clinical areas. While this review provides some insights into the efficacy of VR in clinical rehabilitation and its complimentary use with neuroimaging (e.g., fNIRS and EEG) and neuromodulation (e.g., tDCS and rTMS), more research is needed to understand how different clinical conditions are affected by VR therapies (e.g., stimulus presentation, interactivity, control and types of VR). Future studies should consider large, longitudinal randomized controlled trials to determine the true potential of VR therapies in various clinical populations.

Virtual reality training for micro-robotic cell injection

This research was carried out to fill the gap within existing knowledge on the approaches to supplement the training for micro-robotic cell injection procedure by utilising virtual reality and haptic technologies.

Realistic grasping of rigid virtual objects through event-based haptics

This research presents a novel haptic grasping interface and demonstrates its ability within multi-point event-based feedback. Through experimental methodology, the dynamics involved in grasp contact interactions are modelled based on first principles. The proposed approach demonstrates a method of realistically representing grasp contact with rigid virtual objects through multi-point interaction.

Haptically enabled interactivity and immersive virtual assembly

Virtual training systems are attracting paramount attention from the manufacturing industries due to their potential advantages over the conventional training practices such as general assembly. Within this virtual training realm for general assembly, a haptically enabled interactive and immersive virtual reality (HIVEx) system is presented. The idea is to imitate real assembly training scenarios by providing comprehensive user interaction as well as by enforcing physical constraints within the virtual environment through the use of haptics technology. The developed system employs a modular system approach providing flexibility of reconfiguration and scalability as well as better utilization of the current multi-core computer architecture. The user interacts with the system using haptics device and data glove while fully immersed into the virtual environment with depth perception. An evaluation module, incorporated into the system, automatically logs and evaluates the information through the simulation providing user performance and improvements over time. A ruggedized portable version of the system is also developed and presented with full system capabilities allowing easy relocation with different factory environments. A number of training scenarios has been developed with varying degree of complexity to exploit the potential of the presented system. The presented system can be employed for teaching and training of existing assembly processes as well as the design of new optimised assembly operations. Furthermore, the presented system can assist in optimizing existing practices by evaluating the effectiveness and the level of knowledge transfer involved in the process. Within the aforementioned conceptual. framework, a working prototype is developed.

Haptically enable interactive virtual assembly training system development and evaluation

Virtual training systems are attracting paramount attention from the manufacturing industries due to their potential advantages over the conventional training practices. Significant cost savings can be realized due to the shorter times for the development of different training-scenarios as well as reuse of existing designed engineering (math) models. In addition, use of computer based virtual reality (VR) training systems can shorten the time span from computer aided product design to commercial production due to non-reliance on the hardware parts for training. Within the aforementioned conceptual framework, a haptically enabled interactive and immersive virtual reality (HIVEx) system is presented. Unlike existing VR systems, the presented idea tries to imitate real physical training scenarios by providing comprehensive user interaction, constrained within the physical limitations of the real world. These physical constrains are imposed by the haptics devices in the virtual environment. As a result, in contrast to the existing VR systems that are capable of providing knowledge generally about assembly sequences only, the proposed system helps in cognitive learning and procedural skill development as well, due to its high physically interactive nature.

Crime risks of three-dimensional virtual environments

Three-dimensional virtual environments (3dves) are the new generation of digital multi-user social networking platforms. Their immersive character allows users to create a digital humanised representation or avatar, enabling a degree of virtual interaction not possible through conventional text-based internet technologies. As recent international experience demonstrates, in addition to the conventional range of cybercrimes (including economic fraud, the dissemination of child pornography and copyright violations), the 'virtual-reality' promoted by 3dves is the source of great speculation and concern over a range of specific and emerging forms of crime and harm to users. This paper provides some examples of the types of harm currently emerging in 3dves and suggests internal regulation by user groups, terms of service, or end-user licensing agreements, possibly linked to real-world criminological principles. This paper also provides some directions for future research aimed at understanding the role of Australian criminal law and the justice system more broadly in this emerging field.

The development of a generic framework for the implementation of a cheap, component-based virtual video-conferencing system

We address the problem of virtual-videoconferencing. The proposed solution is effected in terms of a generic framework based on an in-house Virtual Reality system. The framework is composed of a number of distinct components: model acquisition, head tracking, expression analysis, network transmission and avatar reconstruction. The framework promises to provide a unique, cheap, and fast system for avatar construction, transmission and animation. This approach affords a conversion from the traditional video stream approach to the management of an avatar remotely and consequently makes minimal demands on network resources.

Enabling multi-point haptic grasping in virtual environments

Haptic interaction has received increasing research interest in recent years. Currently, most commercially available haptic devices provide the user with a single point of interaction. Multi-point haptic devices present a logical progression in device design and enable the operator to experience a far wider range of haptic interactions, particularly the ability to grasp via multiple fingers. This is highly desirable for various haptically enabled applications including virtual training, telesurgery and telemanipulation. This paper presents a gripper attachment which utilises two low-cost commercially available haptic devices to facilitate multi-point haptic grasping. It provides the ability to render forces to the user's fingers independently and using Phantom Omni haptic devices offers several benefits over more complex approaches such as low-cost, reliability, and ease of programming. The workspace of the gripper attachment is considered and in order to haptically render the desired forces to the user's fingers, kinematic analysis is discussed and necessary formulations presented. The integrated multi-point haptic platform is presented and exploration of a virtual environment using CHAI 3D is demonstrated.

Grasping virtual objects with multi-point haptics

The majority of commercially available haptic devices offer a single point of haptic interaction. These devices are limited when it is desirable to grasp with multiple fingers in applications including virtual training, telesurgery and telemanipulation. Multipoint haptic devices serve to facilitate a greater range of interactions. This paper presents a gripper attachment to enable multi-point haptic grasping in virtual environments. The approach employs two Phantom Omni haptic devices to independently render forces to the user's thumb and other fingers. Compared with more complex approaches to multi-point haptics, this approach provides a number of advantages including low-cost, reliability and ease of programming. The ability of the integrated multi-point haptic platform to interact within a CHAI 3D virtual environment is also presented.