Framing student evaluations of university learning and teaching : discursive strategies and textual outcomes

Evaluation in higher education is an evolving social practice, that is, it involves what people, institutions and broader systems do and say, how they do and say it, what they value, the effects of these practices and values, and how meanings are ascribed. The textual products (verbal, written, visual, gestural) that inform and are produced by, for and through evaluative practices are important as they promulgate particular kinds of meanings and values in specific contexts. This paper reports on an exploratory study that sought to investigate, using discourse analysis, the types of evaluative practices that were ascribed value, and the student responses that ensued, in different evaluative instruments. Findings indicate that when a reflective approach is taken to evaluation, students’ responses are more considered, they interrogate their own engagement in the learning context and they are more likely to demonstrate reconstructive thought. These findings have implications for reframing evaluation as reflective learning.

Teacher and student readiness to use Facebook for learning in an adult vocational educational setting

The factors influencing both teacher and student readiness to use Facebook as part of their teaching and learning in a vocational educational institution were studied through a qualitative case study. Data included teacher and student questionnaire and focus group interviews. While it was found that the students demonstrated readiness and willingness to incorporate Facebook into their current learning, the teachers were more reluctant. Different perceptions around control of learning, time, and concerns around compartmentalisation of learning and social lives would need to be addressed before Facebook could be used as a formal learner engagement strategy.

Suicide, statistics and the coroner: A comparative study of death investigations

Australia has a significantly higher suicide rate than England. Rather than accepting that this ‘statistical fact’ is a direct reflection of some positivist truth, this paper begins with the premise that how suicide is counted depends upon what counts as suicide. This study involves semi-structured interviews with coroners both in Australia and England, as well as observations at inquests. Important differences between the two coronial systems include: first, quite different logics of operation; second, the burden of proof for reaching a finding of suicide is significantly higher in England; and third, the presence of family members at English inquests results in far greater pressure being brought to bear upon coroners. These combined factors result in a reduced likelihood of English coroners reaching a finding of suicide. The conclusions are twofold. First, this research supports existing criticisms of comparative suicide statistics. Second, this research adds theoretical weight to criticisms of positivist analyses of social phenomena.

Integrating ‘role play’ in assessment to strengthen professional conduct and accountability of students : a pilot study

BACKGROUND In a process engineering setting, graduates are frequently allocated reviews of existing operations or required to scope new production processes by their supervisors with a view to improving or expanding on operations and overall productivity. These tasks may be carried out in teams and in consultation with the process engineer’s immediate line manager or a more experienced engineer, such as the Production or Maintenance Manager; ultimately reporting to senior management, which is frequently a non-engineer. Although professional skills development is part of engineering curricula, ‘professional conduct’ and ‘accountability’ required for dealing with peers and superiors in industry is not very well addressed at university. Consequently, upon graduation, many students are, in terms of knowledge and experience in this area, underprepared to work effectively in industry settings. PURPOSE The purpose of this study was to develop and implement a role-play scenario within a core 2nd year process engineering unit, so that students could gain knowledge, skills and experience in different aspects (and nuances) of professional conduct and accountability. DESIGN/METHOD In the role-play scenario, students worked in ‘engineering production teams’ to design a process for an iconic Queensland fruitcake and to present their solution and recommendations (culminating in a poster presentation) to an assessment panel consisting of staff, role-playing as, ‘production and plant managers’. Students were assessed on several areas, including professionalism using a criteria referenced assessment guide by a 3-member cross-disciplinary staff panel consisting of a Business Faculty lecturer, an engineer from industry and the lecturer of the Process Engineering unit. Professional conduct and accountability was gauged through direct questioning by the panel. Feedback was also sought from students on various aspects through a survey questionnaire after the role play activity at the end of semester. RESULTS Overall, the role play was very well performed with students achieving an average score of 79.3/100 (distinction grade). Professional conduct as assessed by panel was on average better than scores given for professional accountability (4.0 compared with 3.6 out of 5). Feedback from students indicated that the learning activities had contributed to their overall understanding of the content and the role of process engineers. Industry involvement was rated very highly as contributing to their learning at 4.8 (on Likert scale from 1 – 5) and the poster presentation was rated at 3.6. CONCLUSIONS This pilot study was successful in implementing a new assessment task for modelling professional conduct and accountability within a 2nd year core unit. This task incorporated a role-play activity and there was evidence to suggest that this and associated learning tasks were successful in broadening students’ understanding and skills in this area required for engineering practice. Following feedback given by students and staff, improvements will be made to the nature of the problem, how it is defined, its assessment, and the approach taken in the role-play scenario when the unit is offered in 2014.

Can playing Monopoly™ enhance learning for property students

This paper outlines the initial results from a pilot study into the educational use of the board game Monopoly City™ in a first year property economics unit. This game play was introduced as a fun and interactive way of achieving a number of desired outcomes including: enhanced engagement of first year students; introduction of foundational threshold concepts in property education; introduction of problem solving and critical analysis skills; early acculturation of property students to enhance student retention; and early team building within the Property Economics cohort, all in an engaging and entertaining way. Preliminary results in this research project are encouraging. The students participating in this initial cycle have demonstrated explicit linkages between their Monopoly City™ experiences and foundation urban economic and valuation theories. Students are also recognising the role strategy and chance play in the property sector. However, linking Monopoly City™ activities to assessment has proved important in student attendance and hence engagement.

Predicting reduced driver alertness on monotonous highways : a driving simulator study

Impaired driver alertness increases the likelihood of drivers’ making mistakes and reacting too late to unexpected events while driving. This is particularly a concern on monotonous roads, where a driver’s attention can decrease rapidly. While effective countermeasures do not currently exist, the development of in-vehicle sensors opens avenues for monitoring driving behavior in real-time. The aim of this study is to predict drivers’ level of alertness through surrogate measures collected from in-vehicle sensors. Electroencephalographic activity is used as a reference to evaluate alertness. Based on a sample of 25 drivers, data was collected in a driving simulator instrumented with an eye tracking system, a heart rate monitor and an electrodermal activity device. Various classification models were tested from linear regressions to Bayesians and data mining techniques. Results indicated that Neural Networks were the most efficient model in detecting lapses in alertness. Findings also show that reduced alertness can be predicted up to 5 minutes in advance with 90% accuracy, using surrogate measures such as time to line crossing, blink frequency and skin conductance level. Such a method could be used to warn drivers of their alertness level through the development of an in-vehicle device monitoring, in real-time, drivers' behavior on highways.

Machine learning for activity recognition : hip versus wrist data

Problem addressed Wrist-worn accelerometers are associated with greater compliance. However, validated algorithms for predicting activity type from wrist-worn accelerometer data are lacking. This study compared the activity recognition rates of an activity classifier trained on acceleration signal collected on the wrist and hip. Methodology 52 children and adolescents (mean age 13.7 +/- 3.1 year) completed 12 activity trials that were categorized into 7 activity classes: lying down, sitting, standing, walking, running, basketball, and dancing. During each trial, participants wore an ActiGraph GT3X+ tri-axial accelerometer on the right hip and the non-dominant wrist. Features were extracted from 10-s windows and inputted into a regularized logistic regression model using R (Glmnet + L1). Results Classification accuracy for the hip and wrist was 91.0% +/- 3.1% and 88.4% +/- 3.0%, respectively. The hip model exhibited excellent classification accuracy for sitting (91.3%), standing (95.8%), walking (95.8%), and running (96.8%); acceptable classification accuracy for lying down (88.3%) and basketball (81.9%); and modest accuracy for dance (64.1%). The wrist model exhibited excellent classification accuracy for sitting (93.0%), standing (91.7%), and walking (95.8%); acceptable classification accuracy for basketball (86.0%); and modest accuracy for running (78.8%), lying down (74.6%) and dance (69.4%). Potential Impact Both the hip and wrist algorithms achieved acceptable classification accuracy, allowing researchers to use either placement for activity recognition.

Prediction of activity type in preschool children using machine learning techniques

Objectives Recent research has shown that machine learning techniques can accurately predict activity classes from accelerometer data in adolescents and adults. The purpose of this study is to develop and test machine learning models for predicting activity type in preschool-aged children. Design Participants completed 12 standardised activity trials (TV, reading, tablet game, quiet play, art, treasure hunt, cleaning up, active game, obstacle course, bicycle riding) over two laboratory visits. Methods Eleven children aged 3–6 years (mean age = 4.8 ± 0.87; 55% girls) completed the activity trials while wearing an ActiGraph GT3X+ accelerometer on the right hip. Activities were categorised into five activity classes: sedentary activities, light activities, moderate to vigorous activities, walking, and running. A standard feed-forward Artificial Neural Network and a Deep Learning Ensemble Network were trained on features in the accelerometer data used in previous investigations (10th, 25th, 50th, 75th and 90th percentiles and the lag-one autocorrelation). Results Overall recognition accuracy for the standard feed forward Artificial Neural Network was 69.7%. Recognition accuracy for sedentary activities, light activities and games, moderate-to-vigorous activities, walking, and running was 82%, 79%, 64%, 36% and 46%, respectively. In comparison, overall recognition accuracy for the Deep Learning Ensemble Network was 82.6%. For sedentary activities, light activities and games, moderate-to-vigorous activities, walking, and running recognition accuracy was 84%, 91%, 79%, 73% and 73%, respectively. Conclusions Ensemble machine learning approaches such as Deep Learning Ensemble Network can accurately predict activity type from accelerometer data in preschool children.

A holistic model for blended learning

While the studio environment has been promoted as an ideal educational setting for project-based disciplines, few qualitative studies have been undertaken in a comprehensive way (Bose, 2007). This study responds to this need by adopting Grounded Theory methodology in a qualitative comparative approach. The research aims to explore the limitations and benefits of a face-to-face (f2f) design studio as well as a virtual design studio (VDS) as experienced by architecture students and educators at an Australian university in order to find the optimal combination for a blended environment to maximize learning. The main outcome is a holistic multidimensional blended model being sufficiently flexible to adapt to various setting, in the process, facilitating constructivist learning through self-determination, self-management, and personalization of the learning environment.

Collaborative learning in the rural Indonesian craft industry

The research explores the potential for participatory and collaborative approaches in working with the Indonesian glass-bead rural craft industry, which currently struggles to sustain its business. Contextual inquiry and participatory action research were used to understand the local context, including motivations, barriers and opportunities and to collaboratively develop strategies for advancement and innovation. The study documents participatory design projects undertaken to make, sell and promote hedonic products. It identifies the importance of understanding local context and individual craftsperson aspirations in designing collaborative support programs. It also provides an in depth insight into the Indonesian rural craft industry.

Socially inclusive learning in a community setting

People with mental health problems, learning difficulties and poor literacy and numeracy are at risk of social exclusion including homelessness. They are often disconnected from the Vocational Education and Training (VET) system, with few opportunities for education and employment. Academic research has demonstrated a link between literacy and numeracy and social inclusion, however, the pathways to enact this are not well understood. This report presents insights into how a community based adult literacy program in West End, Brisbane, was first established and has since evolved into a successful model of what we are calling ‘socially inclusive learning’. The research informing the report was conducted as a twelve-month study from April 2013 to April 2014 funded through a partnership involving Anglicare Southern Queensland, A Place to Belong and the School of Public Health and Social Work, Queensland University of Technology. The research was conducted by Greg Marston and Jeffrey Johnson- Abdelmalik. The aim of the study was to clarify the principles, practice and methodology of the Reading and Writing group (hereafter RAW) and identify the characteristics of RAW that support the social inclusion of the individual being provided literacy learning. The questions guiding the research included: • What are the key principles and practices of the RAW model? • How does the acquisition of literacy and numeracy skills contribute to the recovery of people with mental health and other issues? • How can the acquisition of literacy and numeracy skills support people’s social inclusion, including achieving employment and further education outcomes? A related aim of the project was to document how this community based literacy and numeracy program operates so that other organisations with an interest in addressing similar needs can learn from the model, particularly organisations that co-locate support and education and organisations that adopt a recovery approach when working with people with mental health challenges and intellectual and psychiatric disabilities. The report highlights the background to RAW, the learning philosophy of RAW, the profile of the participants in the program and the various roles and responsibilities and structure that supports the work of RAW. The report presents perspectives from the teachers, student participants and tutors on how the group is designed and the principles implemented.

Transforming the core business of teaching and learning in classrooms through ICT

Information and Communication Technology (ICT) has become an integral part of societies across the globe. This study demonstrates how successful technology integration by 10 experienced teachers in an Australian high school was dependent on teacher-driven change and innovation that influenced the core business of teaching and learning. The teachers were subject specialists across a range of disciplines, engaging their Year Eight students (aged 12–14 years) in the Technology Rich Classrooms programme. Two classrooms were renovated to accommodate the newly acquired computer hardware. The first classroom adopted a one-to-one desktop model with all the computers with Internet access arranged in a front-facing pattern. The second classroom had computers arranged in small groups. The students also used Blackboard to access learning materials after school hours. Qualitative data were gathered from teachers mainly through structured and unstructured interviews and a range of other approaches to ascertain their perceptions of the new initiative. This investigation showed that ICT was impacting positively on the core business of teaching and learning. Through the support of the school leadership team, the built environment was enabling teachers to use ICT. This influenced their pedagogical approaches and the types of learning activities they designed and implemented. As a consequence, teachers felt that students were motivated and benefited through this experience.

Factors influencing robustness and effectiveness of conditional random fields in active learning frameworks

Active learning approaches reduce the annotation cost required by traditional supervised approaches to reach the same effectiveness by actively selecting informative instances during the learning phase. However, effectiveness and robustness of the learnt models are influenced by a number of factors. In this paper we investigate the factors that affect the effectiveness, more specifically in terms of stability and robustness, of active learning models built using conditional random fields (CRFs) for information extraction applications. Stability, defined as a small variation of performance when small variation of the training data or a small variation of the parameters occur, is a major issue for machine learning models, but even more so in the active learning framework which aims to minimise the amount of training data required. The factors we investigate are a) the choice of incremental vs. standard active learning, b) the feature set used as a representation of the text (i.e., morphological features, syntactic features, or semantic features) and c) Gaussian prior variance as one of the important CRFs parameters. Our empirical findings show that incremental learning and the Gaussian prior variance lead to more stable and robust models across iterations. Our study also demonstrates that orthographical, morphological and contextual features as a group of basic features play an important role in learning effective models across all iterations.

Learning about and taking action for the environment : child and teacher experiences in a preschool water education program

Water education and conservation programs have grown exponentially in Australian primary and secondary schools and, although early childhood services have been slower to respond to the challenges of sustainability, they are catching up fast. One early program targeted at preschools was the Water Aware Centre Program in northern New South Wales developed by the local water supply authority. This paper reports on a qualitative study of children’s and teachers’ experiences of the program in three preschools. The study’s aim was to identify program attributes and pedagogies that supported learning and action taking for water conservation, and to investigate if and how the program influenced children’s and teachers’practices. Data were collected through an interview with the program designer, conversations with child participants of the program, and a qualitative survey with early childhood staff. A three-step thematic analysis was conducted on the children’s and teachers’ data. Findings revealed that the program expanded children and teachers’ ideas about water conservation and increased their water conservation practices. The children were found to influence the water conservation practices of the adults around them, thus changing practices at school and at home.