Peer mentoring works! How peer mentoring enhances student success in Higher Education:evaluation toolkit

This toolkit, published by the HEA, provides colleagues across the Sector with the practical and methodological tools to empirically evaluate peer mentoring and tutoring. This evaluation kit provides two data collection tools that may be adopted and adapted to meet institutional requirements. The first of these is a survey, developed out of the original survey used in the Peer Mentoring Works Project. Some questions have been added as a result of reflexive application of colleagues and students input as the project has progressed. The second part of the toolkit comprises a qualitative interview guide. This guide is similar to the one used in the research, but again it has been further developed as a result of the project. It may be adapted for use in focus groups or one-to-one interviews. The final document within the kit is a sample consent form.

Educational Objectives and Evaluation of Student's Internship and Practice in Informatics

Report published in the Proceedings of the National Conference on "Education and Research in the Information Society", Plovdiv, May, 2014

Tutors as mediators of exchange student experiences: evaluation of the international student tutor system at the University of Turku

As academic student mobility is increasing, improving the functionality of international operations is recognised as a competitive advantage at tertiary education institutions. Although many scholars have researched the experiences of exchange students, the role of student tutors and their contribution to exchange students’ experiences is still an unknown factor. This research examines international tutoring at the University of Turku, and aims to understand better the way tutoring contributes to exchange experiences and to explore the functionality of the tutor system and discover areas for improvements. To achieve these goals, the research seeks to answer the fundamental research question: What is the role of tutors in mediating exchange experiences? The theoretical framework combines literature on mediating exchange experiences, the phenomenon of studying abroad, the process of adaptation, the importance of cross-cultural communication, and the role of student tutors as mediators. Based on the literature review, a theoretical model for studying the mediation of exchange experiences is introduced. The model’s applicability and validity is examined through a case study. Three methods were used in the empirical research: surveys, participant observations, and interviews. These methods provided extensive data from three major parties of the tutor system: tutors, exchange students, and the international office. The findings of the research reveal that tutoring – instrumental leading and social and cultural mediating – generates both negative and positive experiences depending on the individuals’ expectations, motivations, relationships, and the nature of the tutoring. Although functional, there are a few weaknesses in the tutor system. Tutors tend to act as effective instrumental leaders, but often fail to create a friendship and contribute to the exchange students’ experience through social and cultural mediation, which is significantly more important in the exchange students’ overall experience in terms of building networks, adapting, gaining emotional experiences, and achieving the stage of personal development and mental change. Based on the weaknesses, three improvements are suggested: (1) increasing comprehensive sharing of information, effective communication, and collective cooperation, (2) emphasising the importance of social and cultural mediation and increasing the frequency of interaction between tutors and exchange students, and (3) improving the recruitment and training, revising the process of reporting and rewarding, and finally, enhancing services and coordination.

Orals ain't orals : how instruction and assessment practices affect delivery choices with prepared student oral presentations.

Despite an ostensibly technology-driven society, the ability to communicate orally is still seen as an essential ability for students at school and university, as it is for graduates in the workplace. The need to develop effective oral communication skills is often tied to future work-related tasks. One tangible way that educators have assessed proficiency in this area is through prepared oral presentations. While some use the terms oral communication and oral presentation interchangeably, other writers question the role more formal presentations play in the overall development of oral communication skills. Adding to the discussion, this paper is part of a larger study examining the knowledge and skills students bring into the academy from previous educational experiences. The study examines some of the teaching and assessment methods used in secondary schools to develop oral communication skills through the use of formal oral presentations. Specifically, it will look at assessment models and how these are used as a form of instruction as well as how they contribute to an accurate evaluation of student abilities. The purpose of this paper is to explore key terms and identify tensions between expectations and practice. Placing the emphasis on the ‘oral’ aspect of this form of communication this paper will particularly look at the ‘delivery’ element of the process.

Authentic and conventional assessment in Singapore schools : an empirical study of teacher assignments and student work

This is an empirical examination of the quality of teacher assignments and student work in Singapore schools. Using a theoretical framework based on principles of authentic assessment and intellectual quality, two sets of criteria and scoring rubrics were developed for the training of expert teachers to judge the quality of assignments and student work. Following rigorous training, the inter-rater reliability of expert teacher scoring was high. Samples of teacher assignments and student work were collected in English, social studies, mathematics, and science subject areas from a random stratified sample of 30 elementary schools and 29 high schools. For both grade levels, there were significant differences for the authentic intellectual quality of teachers’ assignments by subject area. Likewise, the differences of authentic intellectual quality for student work were significant and varied by subject area. Subject area effect was large. The correlations between the quality of teachers’ assignment tasks and student work were strong and significant at both grade levels. Where teachers set more intellectually demanding tasks, students were more likely to generate work or artefacts judged to be of higher quality. The findings suggest that teacher professional development in authentic intellectual assessment task design can contribute to the improvement of student learning and performance. It is argued that this will be a key requisite of educational systems like Singapore that are seeking to expand pedagogy and student outcomes beyond a focus on factual and rote knowledge.

Student success : the identification and support of first year university students at risk of attrition

The engagement behaviour of 1,524 student-enrolments (“students”) in five first year units was monitored and 608 (39.9%) were classified as “at risk” using the criterion of not submitting or failing their first assignment. Of these, 327 (53.8%) were successfully contacted (i.e., spoken to by phone) and provided with advice and/or referral to learning and personal support services while the remaining 281 (46.2%) could not be contacted. Nine hundred and sixteen students (60.1%) were classified as “not at risk.” Overall, the at risk group who were contacted achieved significantly higher end-of-semester final grades than, and persisted (completed the unit) at more than twice the rate of, the at risk group who were not contacted. There were variations among the units which were explained by the timing of the first assignment, specific teaching-learning processes and the structure of the curriculum. Implications for curriculum design and supporting first year students within a personal, social and academic framework are discussed.

Aligning ICT in assessment with teaching and learning : enhancing student achievement in the middle years

Student underachievement in the middle years (typically Years 4 to 9) is a concern in education. Incorporating Information and Communication Technologies (ICT) in assessment that is aligned to teaching and learning has the potential to engage students in higher cognitive processes that lead to increased student achievement. To examine this proposition an investigation was undertaken into teachers’ perceptions of alignment and the implications of those for student achievement in ICT enhanced middle years assessment tasks. This investigation used a collective case study design underpinned by socio-cultural theory. Two methods were used for data collection, namely, semi-structured interviews with individual teachers and a focus group discussion with teachers and another with students. Findings revealed teachers’ perceptions that alignment: assists in mediating achievement of learning outcomes in quality middle years assessment tasks, assists in creating a challenging but supportive environment in which positive learning dispositions and success is encouraged for all students, and contributes to more rigorous use of ICT in assessment. The process of implementing alignment was found to be complex but assisted through prioritising particular practices. These findings enabled the development of eight steps which serve as a guide to the effective implementation of alignment in middle years assessment tasks.

Property Education : an evaluation of how well undergraduate property students are prepared for commencing their careers

The evolution of property education to adapt to the changing business environment requires changes to course content, method of delivery and assessment. Many universities have a special interest in understanding how the students transition in and transition out of the property programs. The impact of the first year student experience is often easier to assess through students’ progression in the course and performance in their intermediate and advanced units. However, the students’ success in transitioning from university student to property professional is often more difficult to determine. In an environment where many property students commence their professional careers while still completing their undergraduate property qualification, a survey of current final year students was undertaken to identify the students’ perception of their level of preparedness for entry into the professional world. This study has also been informed by feedback received from and informal discussions held with industry representative bodies, alumni and senior members of professional organisations. The QUT UD40 Bachelor of Urban Development, Property Economics course has been designed to achieve graduate capabilities in core technical skills and generic professional skills which are required by property professionals. The results of this study were that some units in the program were perceived to provide direct preparation for students commencing their professional careers whilst the impact of other units was less tangible. Valuable feedback received during the study included an assessment of the relevance of many multi-disciplinary units, the appropriateness of the programming of units within the course and the appropriateness of repetition of content during the course. The further research question arises as to how universities can better assist students in the transition to the professional environment when frequently this occurs prior to completion of the property course.

Changing motorcycle rider safety attitudes and motives for risk taking : process evaluation of a rider training intervention

Risk-taking behaviour by motorcyclists has been shown to contribute to a substantial proportion of road crashes in Australia and abroad. Concern has been expressed that traditional motorcycle licence training programs do not sufficiently address such behaviour. Accordingly, the Three Steps to Safer Riding program was developed to address risk taking behaviour by riders as an adjunct to existing skills-based rider training. The program was designed to be delivered in a one hour classroom session at the start of training, with a 20 minute debrief to revise the key concepts at the end of training. This paper reports on the key training concepts, methodology and implementation of the pilot program with a major rider training organisation in Queensland and presents findings from a process evaluation. The Three Steps to Safer Riding intervention pilot was delivered to 518 learner riders over a three month period. Follow-up focus groups and one interview with intervention participants (N=18) five to eight months after completion of the program suggest that new riders (absolute novices) embraced and internalised many of the intervention concepts. However, some riders who had previous riding experience prior to training stated these issues were common sense, yet still expressed riding styles that were contrary to some of the key intervention messages. This is discussed in terms of raising awareness of risk issues for motorcyclists versus behaviour change. Additionally, interviews conducted with riding instructors are discussed regarding logistical challenges of implementation, training consistency, skills required to deliver the program, support for the program, and student engagement.

Enhancing Student Learning in Large Undergraduate Clasees by Using Audio-visual Case Studies

Critical skills such as identifying and appreciating issues that confront firms engaging in international business, and the ability to undertake creative decision-making, are considered fundamental to the study of International Business. It has been argued that using audio-visual case studies can help develop such skills. However, this is difficult due to a lack of Australian case studies. This paper reviews the literature outlining the advantages believed to result from the use of audio-visual case studies, describes a project implemented in a large cohort of students studying International Business, reports on a pilot evaluation of the project, and outlines the findings and conclusions of the survey.

Sampling perceptions; testing reality : an evidence-based approach to measurably improve information literacy and student research skills

Do commencing students possess the level of information literacy (IL) knowledge and skills they need to succeed at university? What impact does embedding IL within the engineering and design curriculum have? This paper reports on the self-perception versus the reality of IL knowledge and skills, across a large cohort of first year built environment and engineering students. Acting on the findings of this evaluation, the authors (a team of academic librarians) developed an intensive IL skills program which was integrated into a faculty wide unit. Perceptions, knowledge and skills were re-evaluated at the end of the semester to determine if embedded IL education made a difference. Findings reveal that both the perception and reality of IL skills were significantly and measurably improved.