Human performance measures for interactive haptic-audio-visual interfaces

Virtual reality and simulation are becoming increasingly important in modern society and it is essential to improve our understanding of system usability and efficacy from the users’ perspective. This paper introduces a novel evaluation method designed to assess human user capability when undertaking technical and procedural training using virtual training systems. The evaluation method falls under the user-centred design and evaluation paradigm and draws on theories of cognitive, skillbased and affective learning outcomes. The method focuses on user interaction with haptic-audio-visual interfaces and the complexities related to variability in users’ performance, and the adoption and acceptance of the technologies. A large scale user study focusing on object assembly training tasks involving selecting, rotating, releasing, inserting and manipulating 3D objects was performed. The study demonstrated the advantages of the method in obtaining valuable multimodal information for accurate and comprehensive evaluation of virtual training system efficacy. The study investigated how well users learn, perform, adapt to and perceive the virtual training. The results of the study revealed valuable aspects of the design and evaluation of virtual training systems contributing to an improved understanding of more usable virtual training systems.

Improving middle years mathematics and science

The overall aim of the Improving Middle Years Mathematics and Science (IMYMS) project was to explore the explore the nature and significance of subject cultures in framing teacher and school practice in mathematics and science and to develop a middle years school improvement model that takes account of these subject cultures in influencing school and teacher change. The project also investigated ways in which effective pedagogies in mathematics and science can be monitored; and ways in which higher order learning outcomes in mathematics and science can be reliably assessed.

The project has worked with more than 30 schools in four clusters to support them in planning for and implementing change. A framework describing effective mathematics and science pedagogies was developed, and used as the basis for auditing procedures that track classroom practice. Instruments were developed and used to probe: teacher classroom practice; student perceptions of classroom practice and learning preferences; knowledge outcomes; reasoning in science and mathematics; understanding of the nature of science and mathematics; and performance skills in mathematics and science investigations. Data sources have also included questionnaire data, interviews, school reports and field notes. Video data was also collected and used for stimulated recall interviews concerning teacher beliefs and practices.

In order to support teachers and schools to improve their practice, the project team worked with cluster educators in each of the clusters, and with school coordinators, through a number of network meetings including an initial ‘leading change’ workshop, through cluster visits, and the provision of auditing and planning instruments supported by data analysis support. The nature of the subject cultures of, and effective pedagogies in, mathematics and science, was explored using interview data with effective teachers, literature exploration, interviews with project teachers to map characteristics of their practice, the team’s experience of the construction and analysis of achievement tests, a video and interview study of teachers of mathematics and science, and student perceptions data.

The final piece of the puzzle : assessment of information literacy in graduate medical students

Deakin University graduate entry medical students come from a varied knowledge base with regard to information research.

Assessment for the learning outcomes of information literacy modules will help to determine effective development of information searching skills for future clinical practice, teaching effectiveness, and identification of skills requiring additional support.

Assessment aims to provide encouragement to engage with the content being taught.

Assessment of primary 5 students' mathematical modelling competencies

 Mathematical modelling is increasingly becoming part of an instructional approach deemed to develop students with competencies to function as 21st century learners and problem solvers. As mathematical modelling is a relatively new domain in the Singapore primary school mathematics curriculum, many teachers may not be aware of the learning outcomes and competencies needed to develop in their students during mathematical modelling. This paper reports on the assessment of two groups of Primary 5 students’ (aged 11) mathematical modelling competencies in their first attempt in completing a modelling task. The students’ competencies are assessed to be at levels 1 and 2 of a researcher-designed rubric. Findings appear to suggest that students faced particular challenges in formulating a mathematical problem from the real-world problem through making assumptions. Implications on teacher education on the facilitation of problem formulation and mathematisation during mathematical modelling at the primary level are drawn.

Self-conscious emotion: how two teachers explore the emotional work of teaching

Teachers are constantly involved in emotional management. This chapter focuses on two second year teachers and the self-conscious emotional work of teaching. Both teachers were working in a prep ( 5-year-olds) class. The teachers engaged in The Participatory Inquiry Program (PIP), which is framed by active and critical reflections on classroom practices. The teachers collaborated with each other, firstly filming the other's practice, and then acting as a critical peer when reviewing the other's film. Teachers also examined internal feelings and thought processes that influenced their actions. The teachers concluded their participation in PIP by narrating their experience and learning. These narratives were then analysed by focusing on how they became cognisant of emotion and emotion regulation that enhances practice and learning outcomes. Emotion work for these two teachers revolved around three key themes: the emotion work with regard to colleagues; the emotional work that arises in relation to students (feelings of love; annoyance, anger), and emotion and self-awareness.

Using an online simulation to address equity issues for off-campus students

The Middle East Politics Simulation (MEPS) is an online role-play exercise aimed at providing students with an improved level of understanding of the political dimensions of the Middle East, including the complexities of negotiation and decision making that face actors in this turbulent region. An online version of MEPS has been running since 1993, initially from Macquarie University, and since 2008 from Deakin University. This longevity provides a useful longitudinal perspective on utilising a collaborative online workplace to offer enhanced learning outcomes in the study of a political topic. The wholly online nature of the simulation means that students of all study modes and even different institutions can participate and benefit equally, thus negating some of the disadvantages faced by off-campus students in learning and assessment. Additionally, the student experience and depth of learning provided by the simulation constitute an excellent example of using the strengths of an e-learning environment to offer an alternative method of engaging and assessing students, which may be beneficial for accommodating the needs of those with differing learning styles.

Best assessment practices of final year engineering projects in Australia

Counterfactual thinking and anticipated emotions enhance performance in computer skills training

The present study examined the relationship between novice learners’ counterfactual thinking (i.e. generating ‘what if’ and ‘if only’ thoughts) about their initial training experience with a computer application and subsequent improvement in task performance. The role of anticipated emotions towards goal attainment in task performance was also assessed. Undergraduate students (N ¼ 42) with minimal experience in using computer spreadsheets underwent basic training in using Microsoft Excel. All participants were assessed on their anticipated positive and negative emotions regarding goal attainment at the outset. After completing their first task, participants allocated to a counterfactual condition received instructions to generate counterfactual thoughts regarding their initial task performance, whereas participants in a control condition did not. The counterfactual group showed only marginally greater improvement in task performance (measured by task completion time and accuracy) than the control group.  However, we also found that positive anticipated emotions were associated with improvement in task performance but for the counterfactual group only. Our data have implications for incorporating counterfactual thinking into information technology skills training to enhance learning outcomes for novice learners.

TOBY play-pad application to teach children with ASD – a pilot trial

 Purpose: To investigate use patterns and learning outcomes associated with the use of Therapy Outcomes By You (TOBY. Playpad, an early intervention iPad application. Methods: Participants were 33 families with a child with an autism spectrum disorder (ASD) aged 16 years or less, and with a diagnosis of autism or pervasive developmental disorder - not otherwise specified, and no secondary diagnoses. Families were provided with TOBY and asked to use it for 4-6 weeks, without further prompting or coaching. Dependent variables included participant use patterns and initial indicators of child progress. Results: Twenty-three participants engaged extensively with TOBY, being exposed to at least 100 complete learn units and completing between 17% and 100% of the curriculum. Conclusions: TOBY may make a useful contribution to early intervention programming for children with ASD delivering high rates of appropriate learning opportunities. Further research evaluating the efficacy of TOBY in relation to independent indicators of functioning is warranted.

The delivery of teacher education programmes in regional Victoria, Australia: Opportunities and challenges

A significant number of Australian universities have multiple campuses (Winchester and Sterk 2006). To manage successful student learning outcomes, Winchester and Sterk (2006) argue that universities may experience challenging teaching and learning issues such as fragmentation, duplication, inconsistency and lack of equitable opportunities for students across the various sites. In recent years, online educational technology has enabled Australian universities to rethink the ways in which they deliver programmes (Smith, Ling and Hill 2006). Such a paradigm and technological shift provide a ‘window of opportunity’ to meet the challenging demands of serving multiple campuses (Bottomley 2000), especially those in regional areas. In Victoria, at June 2012, the regional population was 1.38 million (Australian Bureau of Statistics 2013). However, Polesel’s (2009) report found that students from regional areas defer university at twice the rate of metropolitan students. There is also evidence that students in regional areas, on the one hand, consider such areas as a learning environment with many advantages (e.g. small classes and a compact campus)(Ellis et al. 2005). On the other hand, students’ different interests can often be overlooked in educational settings (Semke and Sheridan 2012).
This paper will report on the results of a baseline study using survey methodology, which examined the challenges and opportunities of delivering elements of two undergraduate programmes in regional areas in Victoria, Australia. In particular, the research focused on two selected undergraduate teacher education programmes: (1) primary education; and (2) early childhood education. Focused discussion data, gathered from academics involved in delivering the programmes in the regional campuses will be presented as an analysis of issues and practices of teaching and learning in the 21st century. Implications for the provision of a quality learning experience and environment for students and for the course marketing strategies will be discussed.

Principal led school improvement and teacher capacity building in the Barwon South Network : final report, May 2013

The period of interest for this report is the beginning of 2011 to the end of 2012. The period commenced when the Regional Network Leader of the Barwon South Network of schools in the Barwon South Region of the Department of Education and Early Childhood contacted the School of Education at Deakin University, Waurn Ponds Campus Geelong. The Regional Network Leader outlined a desire to engage with Deakin University to research a short-term-cycle model of school improvement to be implemented in the region. While the model was expected to be taken on by all schools in the region the research was limited to the 23 schools in the Barwon South Network with four schools to be investigated more closely for each of two years (2001 & 2012) – eight focus schools in total.

Many positive outcomes flowed from the implementation of short-term-cycle school improvement plans and their associated practices but there was wide variation in the nature and degrees of success and of the perception of the process. The research team asked the following questions of the data:

1. What aspects of the School Improvement Plan (SIP) approach were important for initiating and supporting worthwhile change?
2. What might we take from this, to provide guidance on how best to support change in teaching and learning processes in schools?

The School Improvement Plan (SIP) worked in a range of ways. At one level it was strongly focused on school leadership, and a need to improve principals’ capacity to initiate worthwhile teaching and learning processes in their schools. Underlying this intent, one might think an assumption is operation is that the leadership process involves top down decision-making and a willingness to hold staff accountable for the quality of their practice.

The second strong focus was on the translation into practice and the consequent effect on student learning, involving an emphasis on data and evidence led practice. Hence, along with the leadership focus there was a demand for the process of school improvement to reach down into students and classrooms. Thus, the SIP process inevitably involved a chain of decision-making by which student learning quality drove the intervention, and teachers responsible for this had a common view. The model therefore should not be seen as an intervention only on the principal, but rather on the school decision-making system and focus. Even though it was the principal receiving the SIP planning template, and reporting to the network, the reporting was required to include description of the operation of the school processes, of classroom processes, and of student learning. This of course placed significant constraints on principals, which may help explain the variation in responses and outcomes described above.

The findings from this study are based on multiple data sources: analysis of both open and closed survey questions which all teachers in the 23 schools in the network were invited to complete; interviews with principals, teachers and leaders in the eight case study schools; some interviews with students in the case study schools; and interviews with leaders who worked in the regional network office; and field notes from network meetings including the celebrations days. Celebrations days occurred each school term when groups of principals came together to share and celebrate the improvements and processes happening in their schools. Many of the themes emerging from the analysis of the different data sources were similar or overlapping, providing some confidence in the evidence-base for the findings.

The study, conducted over two years of data collection and analysis, has demonstrated a range of positive outcomes in at the case study schools relating to school communication and collaboration processes, professional learning of principals, leadership teams and classroom teachers. There was evidence in the survey responses and field notes from ‘celebration days’ that these outcomes were also represented in other schools in the network. The key points of change concerned the leadership processes of planning for improvement, and the rigorous attention to student data in framing teaching and learning processes. This latter point of change had the effect of basing SIP processes on a platform of evidence-based change. The research uncovered considerable anecdotal and observational evidence of improvements in student learning, in teacher accounts in interview, and presentations of student work. Interviews with students, although not as representative as the team would have liked, showed evidence of student awareness of learning goals, a key driver in the SIP improvement model. It was, however, not possible over this timescale to collect objective comparative evidence of enhanced learning outcomes.

A number of features of the short-term-cycle SIP were identified that supported positive change across the network. These were: 1) the support structures represented by the network leader and support personnel within schools, 2) the nature of the SIP model – focusing strongly on change leadership but within a collaborative structure that combined top-down and bottom-up elements, 3) the focus on data-led planning and implementation that helped drill down to explicit elements of classroom practice, and 4) the accountability regimes represented by network leader presence, and the celebration days in which principals became effectively accountable to their peers. We found that in the second year of the project, momentum was lost in the case study schools, as the network was dismantled. This raised issues also for the conduct of research in situations of systemic change.

Alongside the finding of evidence of positive outcomes in the case study schools overall, was the finding that the SIP processes and outcomes varied considerably across schools. A number of contextual factors were identified that led to this variation, including school histories of reform, principal management style, and school size and structure that made the short-term-cycle model unmanageable. In some cases there was overt resistance to the SIP model, at least in some part, and this led to an element of performativity in which the language of the SIP was conscripted to other purposes. The study found that even with functioning schools the SIP was understood differently and the processes performed differently, raising the question of whether in the study we are dealing with one SIP or many. The final take home message from the research is that schools are complex institutions, and models of school improvement need to involve both strong principled features, and flexibility in local application, if all schools’ interests in improving teaching and learning processes and outcomes are to be served.

Students’ views on the incorporation of commercial awareness in real estate education

Purpose – The purpose of this paper is to review how real estate students perceive and define commercial awareness, which is one of the most important employability skills. This paper also examines students’ perceptions about how their courses support and develop their commercial awareness. In addition, it compares students’ and academics’ views on commercial awareness and identifies whether there are any gaps.

Design/methodology/approach – This paper presents the research findings of a questionnaire survey and e-mail discussions with students who are currently studying Royal Institution of Chartered Surveyors (RICS)-accredited real estate courses in the UK. The questionnaire aimed to gather students’ views on the definitions and components of commercial awareness and identify what skills and attributes are required for its development. It also evaluates how commercial awareness has been embedded in the real estate courses. The aim of each discussion was to gain deeper insight on how components of commercial awareness are embedded in real estate courses, and 17 discussions were conducted. The contents of the e-mail discussions were analysed and similar themes were identified and coded. The frequency of the answer in the questionnaire and comments from interviewees is presented. The findings from students’ views have been compared to published research reporting UK RICS-accredited real estate course providers’ views on commercial awareness. In addition to descriptive statistics, Fisher’s exact test was used to identify the statistical significance between the academics’ and students’ views on commercial awareness.

Findings – The UK real estate students agreed that the most important definition of commercial awareness is a “person’s ability to understand the economics of business”. They agreed that “financial” component is the most important component of commercial awareness and it is the largest portion of their courses. The most important skill and attribute for commercial awareness development are “critical thinking” and “ability and willingness to update professional knowledge”, respectively. Although the descriptive analysis shows students and academics have different views on the definition and components of commercial awareness and its incorporation within real estate courses, the Fisher exact test shows that only a few elements are different enough to be statistically significant. This analysis shows that while students and academics have slightly different views on commercial awareness they are not very different.  Commercial awareness is an important employability skill, thus, it is still necessary for real estate academics to re-visit the curriculum and to ensure learning outcomes related to commercial awareness have been clearly explained and communicated to students. Furthermore, it is vital for students to obtain practical experience in order to fully develop their commercial awareness. 

Originality/value – This paper is a pioneer study focused on reviewing real estate students’ views on commercial awareness, including identifying its definition, components and evaluating the extent to which commercial awareness has been embedded in their courses. It also identifies the skills and attributes that students thought were required for the development of commercial awareness.  Furthermore, it discusses students’ preferred ways of enhancing their commercial awareness as part of the course they are studying. It is the first study identifying the statistical difference between students’ and academics’ views on commercial awareness. The understanding of students’ views on commercial awareness, their preferred delivery method and the divergence between students’ and academics’ views on commercial awareness can provide useful insights for course directors on the development and renewal of real estate course curriculum