Building and sustaining a culture to support peer review of teaching

1. Background/context This presentation will report on emerging results from a two phase project funded by the Australian Learning and Teaching Council (ALTC). The project was designed in partnership with five universities and aimed to embed peer review within the local teaching and learning culture by using a distributive leadership framework. 2. The initiative/practice The presentation will highlight research outcomes that bring together both the fundamentals of peer review of teaching with the broader contextual elements of Integration, Leadership and Development. It will be demonstrated that peer review of teaching can be implemented and have advantages for academic staff, teaching evaluation and an organisation if attention is given to strategies that influence the contexts and cultures of teaching. Peer review as a strategy to develop excellence in teaching is considered from a holistic perspective that by necessity encompasses all elements of an educational environment. Results demonstrate achievements that can be obtained through working to foster conditions needed for sustainable leadership and change. The work has implications for policy, research, teaching development and student outcomes and has potential application world-wide. 3. Method(s) of evaluative data collection and analysis The 2 phase project collected focus group and questionnaire data to inform research results that were analysed using a thematic qualitative approach and statistical exploration. 4. Evidence of effectiveness The presentation will demonstrate the effectiveness of distributive leadership and strategic approaches to working for cultural change through the presentation of project findings.

Developing a culture to support peer review of teaching in higher education

This presentation addresses issues related to leadership, academic development and scholarship of teaching and learning, and highlights research funded by the Australian Office of Learning and Teaching (OLT) designed to embed and sustain peer review of teaching within the culture of 5 Australian universities: Queensland University of Technology, University of Technology, Sydney, University of Adelaide, Curtin University, and Charles Darwin University. Peer review of teaching in higher education will be emphasised as a professional process for providing feedback on teaching and learning practice, which if sustained, can become an effective ongoing strategy for academic development (Barnard et al, 2011; Bell, 2005; Bolt and Atkinson, 2010; McGill & Beaty 2001, 1992; Kemmis & McTaggart, 2000). The research affirms that using developmental peer review models (Barnard et al, 2011; D'Andrea, 2002; Hammersley-Fletcher & Orsmond, 2004) can bring about successful implementation, especially when implemented within a distributive leadership framework (Spillane & Healey, 2010). The project’s aims and objectives were to develop leadership capacity and integrate peer review as a cultural practice in higher education. The research design was a two stage inquiry process over 2 years. The project began in July 2011 and encompassed a development and pilot phase followed by a cascade phase with questionnaire and focus group evaluation processes to support ongoing improvement and measures of outcome. Leadership development activities included locally delivered workshops complemented by the identification and support of champions. To optimise long term sustainability, the project was implemented through existing learning and teaching structures and processes within the respective partner universities. Research outcomes highlight the fundamentals of peer review of teaching and the broader contextual elements of integration, leadership and development, expressed as a conceptual model for embedding peer review of teaching within higher education. The research opens a communicative space about introduction of peer review that goes further than simply espousing its worth and introduction. The conceptual model highlights the importance of development of distributive leadership capacity, integration of policies and processes, and understanding the values, beliefs, assumptions and behaviors embedded in an organizational culture. The presentation overviews empirical findings that demonstrate progress to advance peer review requires an ‘across-the-board’ commitment to embed change, and inherently demands a process that co-creates connection across colleagues, discipline groups, and the university sector. Progress toward peer review of teaching as a cultural phenomenon can be achieved and has advantages for academic staff, scholarship, teaching evaluation and an organisation, if attention is given to strategies that influence the contexts and cultures of teaching practice. Peer review as a strategy to develop excellence in teaching is considered from a holistic perspective that by necessity encompasses all elements of an educational environment and has a focus on scholarship of teaching. The work is ongoing and has implication for policy, research, teaching development and student outcomes, and has potential application world-wide.

Toward a sustainable culture of peer partnership

This project is a two phase design working in partnership with five universities to develop, implement and systematically embed a distributive leadership model that aims to embed peer partnership (review, development) within the culture of teaching and learning excellence. This presentation will posit a ‘prototype’ peer review leadership model based on ongoing research that brings together both the fundamentals of peer review with the broader importance of context and persons. It will be argued that essential to teaching development is a need to address not only the implementation of peer partnership programs but also strategies to influence and change both the contexts of teaching and the advantages for colleagues. Peer review as a strategy to develop excellence in teaching needs to be considered from a holistic perspective encompassing all elements of the teaching environment. The emphasis is on working to foster the type of conditions needed for leadership and change to begin and be sustained. The work has implications for policy, research, leadership development and student outcomes and has potential application world-wide. Phase 1 has collected focus interview and questionnaire data to inform the research and is being analysed using a thematic qualitative approach and statistical analysis. Evidence is emerging currently as the project is ongoing.

Toward a sustainable culture of peer partnership

This project is a two phase design working in partnership with five universities to develop, implement and systematically embed a distributive leadership model that aims to embed peer partnership (review, development) within the culture of teaching and learning excellence. This presentation will posit a ‘prototype’ peer review leadership model based on ongoing research that brings together both the fundamentals of peer review with the broader importance of context and persons. It will be argued that essential to teaching development is a need to address not only the implementation of peer partnership programs but also strategies to influence and change both the contexts of teaching and the advantages for colleagues. Peer review as a strategy to develop excellence in teaching needs to be considered from a holistic perspective encompassing all elements of the teaching environment. The emphasis is on working to foster the type of conditions needed for leadership and change to begin and be sustained. The work has implications for policy, research, leadership development and student outcomes and has potential application world-wide. Phase 1 has collected focus interview and questionnaire data to inform the research and is being analysed using a thematic qualitative approach and statistical analysis Evidence is emerging currently as the project is ongoing

Developing a culture of peer review of teaching through a distributive leadership approach

Teaching is a core function of higher education and must be effective if it is to provide students with learning experiences that are stimulating, challenging and rewarding Obtaining feedback on teaching is indispensable to enhancing the quality of learning design, facilitating personal and/or professional development and maximising student learning outcomes. Peer review of teaching has the potential to improve the quality of teaching at tertiary level, by encouraging critical reflection on teaching, innovation in teaching practice and scholarship of teaching at all academic levels. However, embedding peer review within the culture of teaching and learning is a significant challenge that requires sustained commitment from senior leadership as well as those in leadership roles within local contexts.

Skill development in first year law students : an evaluation of peer assisted learning across two law units

Universities no longer equip graduates solely with the content knowledge of their discipline, but also with prospective employment skills. Professions also seek graduates who can ‘collaborate, share skills and knowledge, and communicate their ideas effectively’ (Kruck and Reif, 2001, p 37). However, as admission to university does not always guarantee that one is well equipped for the task, first year students also need guidance in the development of academic skills. This session describes two models of peer assisted learning embedded within the Torts and Legal Foundations B units at the Faculty of Law, Queensland University of Technology, and how they are used to supplement student understanding of substantive law with the development of academic and work-related skills. Student perceptions of the programs developed are considered, together with the challenges faced. Session participants will be asked to contribute to a discussion of these challenges and to offer ideas on their redress.

Peer assisted learning and generation Y : a case study

In recent years Australian Law Schools have implemented various forms of peer assisted learning or mentoring, including career mentoring by former students of final year students and orientation mentoring or tutoring by later year students of incoming first year students. The focus of these programs therefore is on the transition into or out of law school. There is not always as great an emphasis however, as part of this transition, on the use of law students belonging to the same unit cohort as a learning resource for each other within their degree. This is despite the claimed preference of Generation Y students for collaborative learning environments, authentic learning experiences and the development of marketable workplace skills. In the workplace, be it professional legal practice or otherwise, colleagues rely heavily on each other for information, support and guidance. In the undergraduate law degree at the Queensland University of Technology (‘QUT’) the Torts Student Peer Mentor Program aims to supplement a student’s understanding of the substantive law of torts with the development of life-long skills. As such it has the primary objective, albeit through discussion facilitated by more senior students, of encouraging first year students to develop for themselves the skills they need to be successful both as law students and as legal practitioners. Examples of such skills include those relevant to: preparation for assessment tasks; group work; problem solving, cognition and critical thinking; independent learning; and communication. Significantly, in this way, not only do the mentees benefit from involvement in the program, but the peer mentors, or program facilitators, themselves also benefit from their participation in the real world learning environment the program provides. This paper outlines the development and implementation of the above program, the pedagogy which influenced it, and its impact on student learning experiences

Randomized trial of a clinic-based, community-supported, lifestyle intervention to improve physical activity and diet : The North Carolina enhanced WISEWOMAN project

Objective To determine if a clinic-based behavioral intervention program for low-income mid-life women that emphasizes use of community resources will increase moderate intensity physical activity (PA) and improve dietary intake. Methods Randomized trial conducted from May 2003 to December 2004 at one community health center in Wilmington, NC. A total of 236 women, ages 40–64, were randomized to receive an Enhanced Intervention (EI) or Minimal Intervention (MI). The EI consisted of an intensive phase (6 months) including 2 individual counseling sessions, 3 group sessions, and 3 phone calls from a peer counselor followed by a maintenance phase (6 months) including 1 individual counseling session and 7 monthly peer counselor calls. Both phases included efforts to increase participants' use of community resources that promote positive lifestyle change. The MI consisted of a one-time mailing of pamphlets on diet and PA. Outcomes, measured at 6 and 12 months, included the comparison of moderate intensity PA between study groups as assessed by accelerometer (primary outcome) and questionnaire, and dietary intake assessed by questionnaire and serum carotenoids (6 months only). Results For accelerometer outcomes, follow-up was 75% at 6 months and 73% at 12 months. Though moderate intensity PA increased in the EI and decreased in the MI, the difference between groups was not statistically significant (p = 0.45; multivariate model, p = 0.08); however, moderate intensity PA assessed by questionnaire (92% follow-up at 6 months and 75% at 12 months) was greater in the EI (p = 0.01; multivariate model, p = 0.001). For dietary outcomes, follow-up was 90% for questionnaire and 92% for serum carotenoids at 6 months and 74% for questionnaire at 12 months. Dietary intake improved more in the EI compared to the MI (questionnaire at 6 and 12 months, p < 0.001; serum carotenoid index, p = 0.05; multivariate model, p = 0.03). Conclusion The EI did not improve objectively measured PA, but was associated with improved self-reported and objective measures of dietary intake.

Moving from outsider to insider : peer status and partnerships between electricity utilities and residential consumers

An electricity demand reduction project based on comprehensive residential consumer engagement was established within an Australian community in 2008. By 2011, both the peak demand and grid supplied electricity consumption had decreased to below pre-intervention levels. This case study research explored the relationship developed between the utility, community and individual consumer from the residential customer perspective through qualitative research of 22 residential households. It is proposed that an energy utility can be highly successful at peak demand reduction by becoming a community member and a peer to residential consumers and developing the necessary trust, access, influence and partnership required to create the responsive environment to change. A peer-community approach could provide policymakers with a pathway for implementing pro-environmental behaviour for low carbon communities, as well as peak demand reduction, thereby addressing government emission targets while limiting the cost of living increases from infrastructure expenditure.

What are pregnant women told about models of maternity care in Australia? A retrospective study of women's reports

Objective To describe women’s reports of the model of care options General Practitioners (GPs) discussed with them at the first pregnancy consultation and women’s self-reported role in decisionmaking about model of care. Methods Women who had recently given birth responded to survey items about the models of care GPs discussed, their role in final decision-making, and socio-demographic, obstetric history, and early pregnancy characteristics. Results The proportion of women with whom each model of care was discussed varied between 8.2% (for private midwifery care with home birth) and 64.4% (GP shared care). Only 7.7% of women reported that all seven models were discussed. Exclusive discussion about private obstetric care and about all public models was common, and women’s health insurance status was the strongest predictor of the presence of discussions about each model. Most women (82.6%) reported active involvement in final decision-making about model of care. Conclusion Although most women report involvement in maternity model of care decisions, they remain largely uninformed about the breadth of available model of care options. Practical implications Strategies that facilitate women’s access to information on the differentiating features and outcomes for all models of care should be prioritized to better ensure equitable and quality decisions.

Sibling bullying perpetration: Associations with gender, grade, peer perpetration, trait anger, and moral disengagement

This study investigated bullying amongst siblings in both traditional and cyber forms, and the associations of gender, grade, peer bullying perpetration, trait anger and moral disengagement. The participants were 455 children in grades 5 to 12 (262 girls and 177 boys with 16 unknown gender) who had a sibling. As the number of siblings who only bullied by technology was low, these associations were not able to be calculated. However, the findings showed that the percentage of sibling traditional bullying perpetration (31.6%) was higher than peer bullying perpetration (9.8%). Sibling bullies reported engaging in complex behaviours of perpetration and victimisation in both the physical and in cyber settings, although the number was small. Gender, trait anger, moral disengagement and bullying peers at school (but not grade) were all significantly associated with sibling traditional bullying perpetration. The implications of the findings are discussed for bullying intervention and prevention programs to understand childhood bullying in diverse contexts.

Radiation therapist peer review: Raising the bar on quality and safety in radiation oncology

Purpose An emerging developmental tool to help radiation therapists achieve better outcomes is 'peer review'. This review of the current literature summarises the challenges and benefits of peer review in both individual and departmental practice. Discussion There is compelling evidence supporting peer review implementation at both individual and department level in many professions. Implementing peer review requires that radiation therapists and other radiation oncology professionals embrace a culture that supports safety. Peer review can identify trends and barriers associated with quality radiotherapy and share best practice or recommend changes accordingly. Support for peer review must come from pre-registration educational systems as well as clinical managers. Continuing professional development in the workplace is nurtured by peer review of radiotherapy practice and an aptitude for this should be viewed as important to the profession as technical and clinical skills. Conclusion It is clear that peer review has the potential to facilitate reflective practice, improve staff motivation and help foster a culture of quality and safety in radiation oncology. To drive the issues of quality and safety a step further radiation therapists need to accept the challenge of adopting peer review methods in day-to-day practice.

The forgotten ones : a case study on conceptualising and implementing a peer mentoring program for postgraduate coursework students

We employed an action research approach to develop a context specific peer mentoring program (Postgrad Assist) that aids first year postgraduate coursework (PGCW) students in their transition to postgraduate study. We explored the transition literature and best practice approaches, undertook comprehensive surveys of both our students and staff, conducted student focus groups, formed a diverse working party, with strong representation from students and adopted an on-going evaluation program to develop and refine Postgrad Assist. The program substantially alleviated transitioning students’ cultural and academic shock, and social isolation. The program makes a contribution to the transition and mentoring research domain in that it challenges the common misconception that PGCW students are similar to undergraduate students with no particular distinguishing features that would suggest a need for a different approach to their mentoring.

The influence of families on early adolescent school connectedness : evidence that this association varies with adolescent involvement in peer drinking networks

School connectedness is central to the long term well-being of adolescents, and high quality parent-child relationships facilitate school connectedness. This study examined the extent to which family relationship quality is associated with the school connectedness of pre- and early teenagers, and how this association varies with adolescent involvement in peer drinking networks. The sample consisted of 7,372 10-14 year olds recruited from 231 schools in 30 Australian communities. Participants completed the Communities that Care youth survey. A multi-level model of school connectedness was used, with a random term for school-level variation. Key independent variables included family relationship quality, peer drinking networks, and school grade. Control variables included child gender, sensation seeking, depression, child alcohol use, parent education, and language spoken at home. For grade 6 students, the association of family relationship quality and school connectedness was lower when peer drinking networks were present, and this effect was nonsignificant for older (grade 8) students. Post hoc analyses indicated that the effect for family relationship quality on school connectedness was nonsignificant when adolescents in grade 6 reported that the majority of friends consumed alcohol. The results point to the importance of familyschool partnerships in early intervention and prevention.

Including or excluding conflicts of interest among expert peer reviewers had little impact on funding success, a case study from Australia

Competition for research funding is intense and the opinions of an expert peer reviewer can mean the difference between success and failure in securing funding. The allocation of expert peer reviewers is therefore vitally important and funding agencies strive to avoid using reviewers who have real or perceived conflicts of interest. This article examines the impact of including or excluding peer reviewers based on their conflicts of interest, and the final ranking of funding proposals. Two 7-person review panels assessed a sample of National Health and Medical Research Council (NHMRC) of Australia proposals in Basic Science or Public Health. Using a pre-post comparison, the proposals were first scored after the exclusion of reviewers with a high or medium conflict, and re-scored after the return of reviewers with medium conflicts. The main outcome measures are the agreements in ranks and funding success before and after excluding the medium conflicts. Including medium conflicts of interest had little impact on the ranks or funding success. The Bland–Altman 95% limits of agreement were ± 3.3 ranks and ± 3.4 ranks in the two panels which both assessed 36 proposals. Overall there were three proposals (4%) that had a reversed funding outcome after including medium conflicts. Relaxing the conflict of interest rules would increase the number of expert reviewers included in the panel discussions which could increase the quality of peer review and make it easier to find reviewers.