A prototype augmented reality collaborative process modelling tool

Identifying, modelling and documenting business processes usually requires the collaboration of many stakeholders that may be spread across companies in inter-organizational business settings. While there are many process modelling tools available, the support they provide for remote collaboration is still limited. This demonstration showcases a novel prototype application that implements collaborative virtual environment and augmented reality technologies to improve remote collaborative process modelling, with an aim to assisting common collaboration tasks by providing an increased sense of immersion in an intuitive shared work and task space. Our tool is easily deployed using open source software, and commodity hardware, and is expected to assist with saving money on travel costs for large scale process modelling projects covering national and international centres within an enterprise.

Towards a service framework for remote sales support via augmented reality

Real-time sales assistant service is a problematic component of remote delivery of sales support for customers. Solutions involving web pages, telephony and video support prove problematic when seeking to remotely guide customers in their sales processes, especially with transactions revolving around physically complex artefacts. This process involves a number of services that are often complex in nature, ranging from physical compatibility and configuration factors, to availability and credit services. We propose the application of a combination of virtual worlds and augmented reality to create synthetic environments suitable for remote sales of physical artefacts, right in the home of the purchaser. A high level description of the service structure involved is shown, along with a use case involving the sale of electronic goods and services within an example augmented reality application. We expect this work to have application in many sales domains involving physical objects needing to be sold over the Internet.

Virtual world process perspective visualization

Product Lifecycle Management has been developed as an approach to providing timely engineering information. However, the number of domain specializations within manufacturing makes such information communication disjointed, inefficient and error-prone. In this paper we propose an immersive 3D visualization of linked domain- specific information views for improving and accelerating communication processes in Product Lifecycle Management. With a common and yet understandable visualization of several domain views, interconnections and dependencies become obvious. The conceptual framework presented here links domain-specific information extracts from Product Lifecycle Management systems with each other and displays them via an integrated 3D representation scheme. We expect that this visualization framework should support holistic tactical decision making processes between domain-experts in operational and tactical manufacturing scenarios.

Design and implementation of a virtual world training simulation of ICU first hour handover processes

Nursing training for an Intensive Care Unit (ICU) is a resource intensive process. High demands are made on staff, students and physical resources. Interactive, 3D computer simulations, known as virtual worlds, are increasingly being used to supplement training regimes in the health sciences; especially in areas such as complex hospital ward processes. Such worlds have been found to be very useful in maximising the utilisation of training resources. Our aim is to design and develop a novel virtual world application for teaching and training Intensive Care nurses in the approach and method for shift handover, to provide an independent, but rigorous approach to teaching these important skills. In this paper we present a virtual world simulator for students to practice key steps in handing over the 24/7 care requirements of intensive care patients during the commencing first hour of a shift. We describe the modelling process to provide a convincing interactive simulation of the handover steps involved. The virtual world provides a practice tool for students to test their analytical skills with scenarios previously provided by simple physical simulations, and live on the job training. Additional educational benefits include facilitation of remote learning, high flexibility in study hours and the automatic recording of a reviewable log from the session. To the best of our knowledge, we believe this is a novel and original application of virtual worlds to an ICU handover process. The major outcome of the work was a virtual world environment for training nurses in the shift handover process, designed and developed for use by postgraduate nurses in training.

Assisting ICU training management with virtual worlds

Conventional training methods for nurses involve many physical factors that place limits on potential class sizes. Alternate training methods with lower physical requirements may support larger class sizes, but given the tactile quality of nurse training, are most appropriately applied to supplement the conventional methods. However, where the importance of physical factors are periphery, such alternate training methods can provide an important way to increase upper class-size limits and therefore the rate of trained nurses entering the important role of critical care. A major issue in ICU training is that the trainee can be released into a real-life intensive care scenario with sub optimal preparation and therefore a level of anxiety for the student concerned, and some risk for the management level nurses, as patient safety is paramount. This lack of preparation places a strain on the allocation of human and non-human resources to teaching, as students require greater levels of supervision. Such issues are a concern to ICU management, as they relate to nursing skill development and patient health outcomes, as nursing training is potentially dangerous for patients who are placed in the care of inexperienced staff. As a solution to this problem, we present a prototype ICU handover training environment that has been developed in a socially interactive virtual world. Nurses in training can connect remotely via the Internet to this environment and engage in collaborative ICU handover training classes.

Evaluation of an Augmented Reality Collaborative Process Modelling System

Identifying, modelling and documenting business processes usually requires the collaboration of many stakeholders that may be spread across companies in inter-organizational business settings. While there are many process modelling tools available, the support they provide for remote collaboration is still limited. This paper investigates the application of virtual environment and augmented reality technologies to remote business process modelling, with an aim to assisting common collaboration tasks by providing an increased sense of immersion in a shared workspace. We report on the evaluation of a prototype system with five key informants. The results indicate that this approach to business process modelling is suited to remote collaborative task settings, and stakeholders may indeed benefit from using augmented reality interfaces.

Interactive product browsing and configuration using remote augmented reality sales services

Real-time remote sales assistance is an underdeveloped component of online sales services. Solutions involving web page text chat, telephony and video support prove problematic when seeking to remotely guide customers in their sales processes, especially with configurations of physically complex artefacts. Recently, there has been great interest in the application of virtual worlds and augmented reality to create synthetic environments for remote sales of physical artefacts. However, there is a lack of analysis and development of appropriate software services to support these processes. We extend our previous work with the detailed design of configuration context services to support the management of an interactive sales session using augmented reality. We detail the context and configuration services required, presenting a novel data service streaming configuration information to the vendor for business analytics. We expect that a fully implemented configuration management service, based on our design, will improve the remote sales experience for both customers and vendors alike via analysis of the streamed information.

Sustaining the future through virtual worlds

Virtual worlds (VWs) continue to be used extensively in Australia and New Zealand higher education institutions although the tendency towards making unrealistic claims of efficacy and popularity appears to be over. Some educators at higher education institutions continue to use VWs in the same way as they have done in the past; others are exploring a range of different VWs or using them in new ways; whilst some are opting out altogether. This paper presents an overview of how 46 educators from some 26 institutions see VWs as an opportunity to sustain higher education. The positives and negatives of using VWs are discussed.

Multiuser virtual safety training system for tower crane dismantlement

Tower crane dismantling is one of the most dangerous activities in the construction industry. Tower crane erection and dismantlement causes 10–12% of the fatalities of all crane accidents. The nature of the task is such that off-the-job training is not practicable, and the knowledge and expertise needed has to be gained on the job. However, virtual trainers such as Microsoft Flight Simulator for airplane pilots and mission rehearsal exercise (MRE) for army personnel have been developed and are known to provide a highly successful means of overcoming the risks involved in such on-the-job learning and clearly have potential in construction situations. This paper describes the newly developed multiuser virtual safety training system (MVSTS) aimed at providing a similar learning environment for those involved in tower crane dismantlement. The proposed training system is developed by modifying an existing game engine. Within the close-to-reality virtual environment, trainees can participate in a virtual dismantling process. During the process, they learn the correct dismantling procedure and working location and to cooperate with other trainees by virtually dismantling the crane. The system allows the trainees to experience the complete procedure in a risk-free environment. A case study is provided to demonstrate how the system works and its practical application. The proposed system was evaluated by interviews with 30 construction experts with different backgrounds, divided into three groups according to their experience and trained by the traditional and virtual methods, respectively. The results indicate that the trainees of the proposed system generally learned better than those using the traditional method. The ratings also indicate that the system generally has great potential as a training platform.

Improving remote collaborative process modelling using embodiment in 3D virtual environments

Identifying, modelling and documenting business processes usually require the collaboration of many stakeholders that may be spread across companies in inter-organizational settings. While modern process modelling technologies are beginning to provide a number of features to support remote, they lack support for visual cues used in co-located collaboration. In this paper, we examine the importance of visual cues for collaboration tasks in collaborative process modelling. Based on this analysis, we present a prototype 3D virtual world process modelling tool that supports a number of visual cues to facilitate remote collaborative process model creation and validation. We then report on a preliminary analysis of the technology. In conclusion, we proceed to describe the future direction of our research with regards to the theoretical contributions expected from the evaluation of the tool.

A virtual environment to simulate the experience of psychosis

Psychosis is a mental disorder that affects 1-2% of the population at some point in their lives. One of the main causes of psychosis is the mental illness schizophrenia. Sufferers of this illness often have terrifying symptoms such as hallucinations, delusions, and thought disorder. This project aims to develop a virtual environment to simulate the experience of psychosis, focusing on re-creating auditory and visual hallucinations. A model of a psychiatric ward was created and the psychosis simulation software was written to re-create the auditory and visual hallucinations of one particular patient. The patient was very impressed with the simulation, and commented that it effectively re-created the same emotions that she experienced on a day-to-day basis during her psychotic episodes. It is hoped that this work will result in a useful educational tool about schizophrenia, leading to improved training of clinicians, and fostering improved understanding and empathy toward sufferers of schizophrenia in the community, ultimately improving the quality of life and chances of recovery of patients.

A theoretical basis for using virtual worlds as a personalised process visualisation approach

Communication processes are vital in the lifecycle of BPM projects. With this in mind, much research has been performed into facilitating this key component between stakeholders. Amongst the methods used to support this process are personalized process visualisations. In this paper, we review the development of this visualization trend, then, we propose a theoretical analysis framework based upon communication theory. We use this framework to provide theoretical support to the conjecture that 3D virtual worlds are powerful tools for communicating personalised visualisations of processes within a workplace. Meta requirements are then derived and applied, via 3D virtual world functionalities, to generate example visualisations containing personalized aspects, which we believe enhance the process of communcation between analysts and stakeholders in BPM process (re)design activities.

Using natural user interfaces for collaborative process modelling in virtual environments

A demo video showing the BPMVM prototype using several natural user interfaces, such as multi-touch input, full-body tracking and virtual reality.

Virtual world cultural probe

We have developed a virtual world environment for eliciting expert information from stakeholders. The intention is that the virtual world prompts the user to remember more about their work processes. Our example shows a sparse visualisation of the University of Vienna Department of Computer Science, our collaborators in this project.