Study of the dimensions that relate to the effectiveness of training systems : a systems approach

The purpose of this thesis is to explore dimensions that relate to the training systems effectiveness in a number of industry categories. The training system is taken as part of the reproducer boundary subsystem within the organisation (Miller 1978). The research has been developed on the assumption that no single criterion is appropriate as a measure of effectiveness of a training system (Campbell et al 1970). An index of criteria based on the different organisational variables that interact within an organisation is employed in the development of the study. In this research the structural variables (independent variables) including industry category, size and formalisation factors of the sample organisations will be related to the effectiveness of training systems in their organisations. This research attempts to formulate hypotheses in the field of training system research to contribute to a theory of training system impact studies. The popular areas of research in the field of training have mainly tended to focus separately on the effectiveness of training programmes, the economics of training, the social impact of training and the dynamics of training. To my knowledge there is no research work that tests the relationship between structure and the effectiveness of training systems.

Systematic evaluation of a virtual environment-based training systems

This paper explores the application of three constructs that deemed to be essential to quantify virtual environments (VE) efficacy: cognitive, skill-based, and affective learning outcomes. The authors discuss the implementation of these constructs in a user-centered evaluation of a VE training system. By transforming both the conceptual and operational cohorts for training evaluation the authors illustrate the benefits of the development of a Multi-dimensional User-centered Systematic Training Evaluation (MUSTe) method for quantifying VEs efficacy. Importantly, MUSTe acknowledges the importance of combining holistic and analytical approaches in conducting systematic user-based evaluation. Furthermore, it also emphasizes that quantifying VEs efficacy must reflect the perception and preferences of the users rather than the imposition of efficacy on single measures of task outcome. An empirical study that applied MUSTe evaluation method in quantifying a VE training system efficacy provided valuable evidence of the theoretical construct and content validity of the method.

The impact of self-efficacy and perceived system efficacy on effectiveness of virtual training systems

This study developed and tested a research model which examined the impact of user perceptions of self-efficacy (SE) and virtual environment (VE) efficacy on the effectiveness of VE training systems. The model distinguishes between the perceptions of one’s own capability to perform trained tasks effectively and the perceptions of system performance, regarding the established parameters from literature. Specifically, the model posits that user perceptions will have positive effects on task performance and memory. Seventy-six adults participated in a VE in a controlled experiment, designed to empirically test the model. Each participant performed a series of object assembly tasks. The task involved selecting, rotating, releasing, inserting and manipulating 3D objects. Initially, the results of factor analysis demonstrated dimensionality of two user perception measures and produced a set of empirical validated factors underlining the VE efficacy. The results of regression analysis revealed that SE had a significant positive effect on perceived VE efficacy. No significant effects were found of perceptions on performance and memory. Furthermore, the study provided insights into the relationships between the perception measures and performance measures for assessing the efficacy of VE training systems. The study also addressed how well users learn, perform, adapt to and perceive the VE training, which provides valuable insight into the system efficacy.
Research and practical implications are presented at the end of the paper.

Haptic technology for micro-robotic cell injection training systems — a review

Currently, the micro-robotic cell injection procedure is performed manually by expert human bio-operators. In order to be proficient at the task, lengthy and expensive dedicated training is required. As such, effective specialized training systems for this procedure can prove highly beneficial. This paper presents a comprehensive review of haptic technology relevant to cell injection training and discusses the feasibility of developing such training systems, providing researchers with an inclusive resource enabling the application of the presented approaches, or extension and advancement of the work. A brief explanation of cell injection and the challenges associated with the procedure are first presented. Important skills, such as accuracy, trajectory, speed and applied force, which need to be mastered by the bio-operator in order to achieve successful injection, are then discussed. Then an overview of various types of haptic feedback, devices and approaches is presented. This is followed by discussion on the approaches to cell modeling. Discussion of the application of haptics to skills training across various fields and haptically-enabled virtual training systems evaluation are then presented. Finally, given the findings of the review, this paper concludes that a haptically-enabled virtual cell injection training system is feasible and recommendations are made to developers of such systems.

Computer-simulated environment for training : challenge of efficacy evaluation

Computer-assisted instruction has been around for decades. There has been much speculation about the benefits of computer-mediated learning. Numerous applications have been developed in different domains incorporated with emerging technologies. In recently years, advanced technologies, such as Augmented Reality (AR) and Virtual Reality (VR), have received much attention in their potential of creating interactive learning experience for the users. However, related literature and empirical studies indicated that learning effects in computer-simulated environments or Virtual Environments (VEs) are not systematically tested. Furthermore, the performance and learning in computer-simulated learning environment need to be evaluated through more rigorous methods. This paper suggests that 1) the efficacy of VEs is subject to a close examination, not only in terms of how VE-based training systems are easy of use, but also in terms of how effective learning is; 2) evaluation of learning in computer simulated learning environments is required to be reconsidered in terms of theoretical basis and evaluation methodologies that are relevant to the measurement of training effectiveness in computer-simulated virtual learning environment. This paper explains on how learning can be assessed in VEs through the lens of training evaluation.

Restructuring of education and training in Vietnam : a development and application of arts management training in Australia to Vietnam

The adoption of a more market-oriented economy under doi moi has paved the way for Vietnam to record remarkable human development achievements in the past decades. The Vietnamese education system has been undergoing continuous changes for almost twenty years. Key reforms have been implemented in the education and training sector such as privatising the sector; expanding the schooling system, the vocational education and training (VET) system, and higher education. This paper examines: (1) key reforms implemented in the education and training sector, placed in a broader context of economic reforms in Vietnam; (2) a development of arts management training courses in Vietnam to assist cultural organisations to adjust to social changes, as Vietnamese education institutions have not had much experience in designing training courses in arts and culture management; (3) several arts management training courses in Australian institutions to see the possibility to apply training in arts management in Australia to Vietnam. The findings indicate that a variety of management training modes in Australia can be adapted and applied to the Vietnamese training context. Some factors such as differences in culture, education and training systems, shortages in training staff and resources are also considered in this paper.

Haptically enable interactive virtual assembly training system development and evaluation

Virtual training systems are attracting paramount attention from the manufacturing industries due to their potential advantages over the conventional training practices. Significant cost savings can be realized due to the shorter times for the development of different training-scenarios as well as reuse of existing designed engineering (math) models. In addition, use of computer based virtual reality (VR) training systems can shorten the time span from computer aided product design to commercial production due to non-reliance on the hardware parts for training. Within the aforementioned conceptual framework, a haptically enabled interactive and immersive virtual reality (HIVEx) system is presented. Unlike existing VR systems, the presented idea tries to imitate real physical training scenarios by providing comprehensive user interaction, constrained within the physical limitations of the real world. These physical constrains are imposed by the haptics devices in the virtual environment. As a result, in contrast to the existing VR systems that are capable of providing knowledge generally about assembly sequences only, the proposed system helps in cognitive learning and procedural skill development as well, due to its high physically interactive nature.

A simulation-based control interface layer for a high-fidelity anthropomorphic training simulator

Deakin University’s futuristic Universal Motion simulator will overcome the limitations of current motion simulator platforms by employing an anthropomorphic robot arm to provide the motion fidelity necessary to exploit the potential of modern simulation environments. Full motion simulators frequently utilize Stewart platforms to mimic the movement of vehicles during simulation. However, due to the limited motion range and dexterity of such systems, and their inability to convey realistic accelerations, they are unable to represent accurate motion characteristics. The Universal Motion Simulation aims to close the gap between the limitations of the current motion technology and real world, by introducing a flexible, modular, high-fidelity motion system that can be used for a variety of immersive training applications. The modular nature of the design allows interchangeable and configurable simulation pods to be attached to the end effectors.

A multi-level approach to planning and scheduling resources for aviation training

This paper describes a multi-level system dynamics (SD) / discrete event simulation (DES) approach for assessing planning and scheduling problems within an aviation training continuum. The aviation training continuum is a complex system, consisting of multiple aviation schools interacting through interschool student and instructor flows that are affected by external triggers such as resource availability and the weather.
SD was used to model the overall training continuum at a macro level to ascertain relationships between system entities. SD also assisted in developing a shared understanding of the training continuum, which involves constructing the definitions of the training requirements, resources and policy objectives. An end-to-end model of the continuum is easy to relate to, while dynamic visualisation of system behaviour provides a method for exploration of the model.
DES was used for micro level exploration of an individual school within the training continuum to capture the physical aspects of the system including resource capacity requirements, bottlenecks and student waiting times. It was also used to model stochastic events such as weather and student availability. DES has the advantage of being able to represent system variability and accurately reflect the limitations imposed on a system by resource constraints.
Through sharing results between the models, we demonstrate a multi-level approach to the analysis of the overall continuum. The SD model provides the school’s targeted demand to the DES model. The detailed DES model is able to assess schedules in the presence of resource constraints and variability and provide the expected capacity of a school to the high level SD model, subjected to constraints such as instructor availability or budgeted number of training systems. The SD model allows stakeholders to assess how policy and planning affect the continuum, both in the short and the long term.
The development of this approach permits moving the analysis of the continuum between SD and DES models as appropriate for given system entities, scales and tasks. The resultant model outcomes are propagated between the continuum and the detailed DES model, iteratively generating an assessment of the entire set of plans and schedule across the continuum. Combining data and information between SD and DES models and techniques assures relevance to the stakeholder needs and effective problem scoping and scaling that can also evolve with dynamic architecture and policy requirements.
An example case study shows the combined use of the two models and how they are used to evaluate a typical scenario where increased demand is placed on the training continuum. The multi-level approach provides a high level indication of training requirements to the model of the new training school, where the detailed model indicates the resources required to achieve those particular student levels.

Haptically enabled interactive virtual reality prototype for general assembly

Desktop computers based virtual training systems are attracting paramount attention from manufacturing industries due to their potential advantages over the conventional training practices. Significant cost savings can be realized due to the shorter training-scenarios development times and reuse of existing engineering models. In addition, by using computer based virtual reality (VR) training systems, the time span from the product design to commercial production can be shortened due to non-reliance on hardware parts. Within the aforementioned conceptual framework, a haptically enabled interactive and immersive virtual reality (HIIVR) system is presented. Unlike existing VR systems, the presented idea tries to imitate real physical training scenarios by providing comprehensive user interaction, constrained within the physical limitations of the real world imposed by the haptics devices within the virtual environment. As a result, in contrast to the existing VR systems, capable of providing knowledge generally about assembly sequences only, the proposed system helps in procedural learning and procedural skill development as well, due to its high physically interactive nature.

Haptically enabled interactivity and immersive virtual assembly

Virtual training systems are attracting paramount attention from the manufacturing industries due to their potential advantages over the conventional training practices such as general assembly. Within this virtual training realm for general assembly, a haptically enabled interactive and immersive virtual reality (HIVEx) system is presented. The idea is to imitate real assembly training scenarios by providing comprehensive user interaction as well as by enforcing physical constraints within the virtual environment through the use of haptics technology. The developed system employs a modular system approach providing flexibility of reconfiguration and scalability as well as better utilization of the current multi-core computer architecture. The user interacts with the system using haptics device and data glove while fully immersed into the virtual environment with depth perception. An evaluation module, incorporated into the system, automatically logs and evaluates the information through the simulation providing user performance and improvements over time. A ruggedized portable version of the system is also developed and presented with full system capabilities allowing easy relocation with different factory environments. A number of training scenarios has been developed with varying degree of complexity to exploit the potential of the presented system. The presented system can be employed for teaching and training of existing assembly processes as well as the design of new optimised assembly operations. Furthermore, the presented system can assist in optimizing existing practices by evaluating the effectiveness and the level of knowledge transfer involved in the process. Within the aforementioned conceptual. framework, a working prototype is developed.

Haptics and virtual reality in modern manufacturing

Product assembly is one of the most studied processes in modern manufacturing. In recent years a number of computer-based virtual reality systems have been proposed, developed and adopted by the manufacturing industries. Such systems have major advantages over conventional training practices for product assembly. Significant cost savings can be realized due to shorter training-scenario development times and reuse of existing engineering math models. In addition, the time span from the product design to full production can be shortened due to non-reliance on actual components and subsystems for training. Such training systems are effective if the knowledge required to be transferred is just process sequence such as assembly sequence. However, knowledge transfer for procedural and cognitive learning as well as skills development is very limited, due to the lack of user interactivity and immersion.

This talk will focus on a research technology platform where haptics and virtual reality are integrated to create an effective environment for production assembly operators’ training. In this system virtual reality provides the grounds for realistic visualization, as well as immersion, whereas haptics enforces physical constraints within the virtual world generating the feelings of realistic interaction, making it accessible for formal learning and better understanding during task performance.

The developed research technology platform imitates real physical training scenarios by providing comprehensive user interaction, constrained within the physical limitations of the real world. Through the utilization of a haptics device, providing realistic force feedback, users are able to engage in product assembly training with a stronger sense of ‘reality’.

Multidimensional evaluation framework for virtual environment efficacy assessment

This research is related to the user-centred design and use of Virtual Environment (VE) training systems. A multidimensional user-centred systematic training evaluation framework that combines ideas from human-computer interaction, training, education and psychology was proposed, which contributes to better design and evaluation of VE user interfaces.