Systematic evaluation of a virtual environment-based training systems

This paper explores the application of three constructs that deemed to be essential to quantify virtual environments (VE) efficacy: cognitive, skill-based, and affective learning outcomes. The authors discuss the implementation of these constructs in a user-centered evaluation of a VE training system. By transforming both the conceptual and operational cohorts for training evaluation the authors illustrate the benefits of the development of a Multi-dimensional User-centered Systematic Training Evaluation (MUSTe) method for quantifying VEs efficacy. Importantly, MUSTe acknowledges the importance of combining holistic and analytical approaches in conducting systematic user-based evaluation. Furthermore, it also emphasizes that quantifying VEs efficacy must reflect the perception and preferences of the users rather than the imposition of efficacy on single measures of task outcome. An empirical study that applied MUSTe evaluation method in quantifying a VE training system efficacy provided valuable evidence of the theoretical construct and content validity of the method.

Learning to manage : transformative outcomes of competency-based training

Transformative learning theory is a dominant approach to understanding adult learning. The theory addresses the way our perspectives on the world, others and ourselves can be challenged and transformed in our ongoing efforts to make sense of the world. It is a conception of learning that does not focus on the measurable acquisition of knowledge and skills, but looks rather to the dynamics of self-questioning and upheaval as the key to adult learning. In this article, transformative learning theory is used as a lens for studying learning in a competency-based, entry-level management course. Instead of asking which knowledge and skills were developed and how effectively, the research enquired into deeper changes wrought by the learning experiences. The research found that for some learners the course contributed to significant discontent as they discovered that management practices they took to represent the norm fell dramatically short of the model promoted in the training.

The "strugglers" in selected computer based mathematics classrooms

In this paper, the experiences of lower achieving mathematics students in two secondary mathematics classrooms in which computers were regularly used are described. A year 8 and a year 9 mathematics class from one secondary school participated in the ethnographic study. The results show that in these two classrooms the learning relationships and power relationships did not, in general, support the learning and engagement of lower achievers in mathematics. Research into computer based teaching methods that engage low achieving students in computer based mathematics is needed.

Girls back off mathematics again : the views and experiences of girls in computer based mathematics

The views and experiences of girls in two co-educational mathematics classrooms in which computers were regularly used were researched. Data were collected by observation and videotaping of lessons, questionnaire, and interviews of students and the teachers. In this paper case studies of six girls are presented. Their ‘stories’ reveal a diversity of experiences and views and multiple gender identities. High achieving girls persisted as “outsiders within,” other girls “backed off”, and exceptional girls challenged gender stereotypes. Implications for social justice in mathematics in the age of the super highway are discussed.

Student views of computer based-mathematics in the middle years : does gender make a difference?

How the use of computers in mathematics classrooms was viewed by students in two middle years mathematics classrooms was the focus of the research described in this paper. The primary data sources consisted of questionnaires, classroom observations supported by videotaping of mathematics lessons, and interviews with two girls and two boys from each class. Thus both qualitative and quantitative methods were used. Girls viewed the computer-based lessons less favourably than did boys. In general, the boys were likely to believe that computers contributed to their experiencing pleasure in these lessons, and to making mathematics more relevant to them. Girls were typically more concerned about whether computers facilitated learning and enabled success in mathematics. The attitudes of students to computer-based mathematics were related to their views of computers.

Competency-based training, global skills mobility and the teaching of international students in vocational education and training

 In Australia, all vocational education and training (VET) qualifications must be based on competency-based training (CBT) and training packages. Yet, since 2005, there has been a major expansion in the number of VET international students in Australia, 85% of whom are from Asia. Given this development, the teaching and learning contexts in which competency-based training and training packages are located are becoming increasingly diverse and no longer reflect the traditional training characteristics and boundaries that apply for domestic students.
This paper examines the relevance of training packages and CBT for teaching international students in the Australian VET sector. It draws on interviews with teachers and international students from 25 public and private training providers in Australia. The discussion of the findings aims to assist the VET sector create a curriculum framework that supports flexibility, adaptation and responsiveness so that international students’ divergent and shifting study purposes and complex learning characteristics can be catered for effectively. This contributes to helping the sector remain viable in a context in which a VET course is no longer a pathway to migration.

Counterfactual thinking and anticipated emotions enhance performance in computer skills training

The present study examined the relationship between novice learners’ counterfactual thinking (i.e. generating ‘what if’ and ‘if only’ thoughts) about their initial training experience with a computer application and subsequent improvement in task performance. The role of anticipated emotions towards goal attainment in task performance was also assessed. Undergraduate students (N ¼ 42) with minimal experience in using computer spreadsheets underwent basic training in using Microsoft Excel. All participants were assessed on their anticipated positive and negative emotions regarding goal attainment at the outset. After completing their first task, participants allocated to a counterfactual condition received instructions to generate counterfactual thoughts regarding their initial task performance, whereas participants in a control condition did not. The counterfactual group showed only marginally greater improvement in task performance (measured by task completion time and accuracy) than the control group.  However, we also found that positive anticipated emotions were associated with improvement in task performance but for the counterfactual group only. Our data have implications for incorporating counterfactual thinking into information technology skills training to enhance learning outcomes for novice learners.

Improving communication when seeking informed consent: a randomised controlled study of a computer-based method for providing information to prospective clinical trial participants

OBJECTIVE: To assess the efficacy, with respect to participant understanding of information, of a computer-based approach to communication about complex, technical issues that commonly arise when seeking informed consent for clinical research trials. DESIGN, SETTING AND PARTICIPANTS: An open, randomised controlled study of 60 patients with diabetes mellitus, aged 27-70 years, recruited between August 2006 and October 2007 from the Department of Diabetes and Endocrinology at the Alfred Hospital and Baker IDI Heart and Diabetes Institute, Melbourne. INTERVENTION: Participants were asked to read information about a mock study via a computer-based presentation (n = 30) or a conventional paper-based information statement (n = 30). The computer-based presentation contained visual aids, including diagrams, video, hyperlinks and quiz pages. MAIN OUTCOME MEASURES: Understanding of information as assessed by quantitative and qualitative means. RESULTS: Assessment scores used to measure level of understanding were significantly higher in the group that completed the computer-based task than the group that completed the paper-based task (82% v 73%; P = 0.005). More participants in the group that completed the computer-based task expressed interest in taking part in the mock study (23 v 17 participants; P = 0.01). Most participants from both groups preferred the idea of a computer-based presentation to the paper-based statement (21 in the computer-based task group, 18 in the paper-based task group). CONCLUSIONS: A computer-based method of providing information may help overcome existing deficiencies in communication about clinical research, and may reduce costs and improve efficiency in recruiting participants for clinical trials.

A taxonomy and mapping of computer-based critiquing tools

Critics have emerged in recent times as a specific tool feature to support users in computer-mediated tasks. These computer-supported critics provide proactive guidelines or suggestions for improvement to designs, code, and other digital artifacts. The concept of a critic has been adopted in various domains, including medical, programming, software engineering, design sketching, and others. Critics have been shown to be an effective mechanism for providing feedback to users. We propose a new critic taxonomy based on extensive review of the critic literature. The groups and elements of our critic taxonomy are presented and explained collectively with examples, including the mapping of 13 existing critic tools, predominantly for software engineering and programming education tasks to the taxonomy. We believe this critic taxonomy will assist others in identifying, categorizing, developing, and deploying computer-supported critics in a range of domains.