Including or excluding conflicts of interest among expert peer reviewers had little impact on funding success, a case study from Australia

Competition for research funding is intense and the opinions of an expert peer reviewer can mean the difference between success and failure in securing funding. The allocation of expert peer reviewers is therefore vitally important and funding agencies strive to avoid using reviewers who have real or perceived conflicts of interest. This article examines the impact of including or excluding peer reviewers based on their conflicts of interest, and the final ranking of funding proposals. Two 7-person review panels assessed a sample of National Health and Medical Research Council (NHMRC) of Australia proposals in Basic Science or Public Health. Using a pre-post comparison, the proposals were first scored after the exclusion of reviewers with a high or medium conflict, and re-scored after the return of reviewers with medium conflicts. The main outcome measures are the agreements in ranks and funding success before and after excluding the medium conflicts. Including medium conflicts of interest had little impact on the ranks or funding success. The Bland–Altman 95% limits of agreement were ± 3.3 ranks and ± 3.4 ranks in the two panels which both assessed 36 proposals. Overall there were three proposals (4%) that had a reversed funding outcome after including medium conflicts. Relaxing the conflict of interest rules would increase the number of expert reviewers included in the panel discussions which could increase the quality of peer review and make it easier to find reviewers.

Teaching peer review reflective processes in accounting

A well designed peer review process in higher education subjects can lead to more confident and reflective learners who become skilled at making independent judgements of their own and others’ work; essential requirements for successful lifelong learning. The challenge for educators is to ensure their students gain these important graduate attributes within the constraints of a range of internal and external tensions currently facing higher education systems, including, respectively, the realities of large undergraduate Accounting subjects, culturally diverse and time-poor academics and students, and increased calls for public accountability of the Higher Education sector by groups such as the OECD. Innovative curriculum and assessment design and collaborative technologies have the capacity to simultaneously provide some measure of relief from these internal and external tensions and to position students as responsible partners in their own learning. This chapter reports on a two phase implementation of an online peer review process as part of the assessment in a large, under-graduate, International Accounting class. Phase One did not include explicit reflective strategies within the process, and anonymous and voluntary student views served to clearly highlight that students were ‘confused’ and ‘hesitant’ about moving away from their own ideas; often mistrusting the conflicting advice received from multiple peer reviewers. A significant number of students also felt that they did not have the skills to constructively review the work of their peers. Phase Two consequently utilised the combined power of e-Technology, peer review feedback and carefully scaffolded and supported reflective practices from Ryan and Ryan’s Teaching and Assessing Reflective Learning (TARL) model (see Chap. 2). Students found the reflective skills support workshop introduced in Phase Two to be highly useful in maximising the benefits of the peer review process, with 83 % reporting it supported them in writing peer reviews, while 90 % of the respondents reporting the workshop supported them in utilising peer and staff feedback.

LeaD-In : a cultural change model for peer review of teaching in higher education

Peer review of teaching is recognized increasingly as one strategy for academic development even though historically peer review of teaching is often unsupported by policy, action and culture in many Australian universities. Higher education leaders report that academics generally do not engage with peer review of teaching in a systematic or constructive manner, and this paper advances and analyses a conceptual model to highlight conditions and strategies necessary for the implementation of sustainable peer review in higher education institutions. The model highlights leadership, development and implementation, which are critical to the success and formation of a culture of peer review of teaching. The work arises from collaborative research funded by the Office for Learning and Teaching to foster and advance a culture of peer review of teaching across several universities in Australia.

Peer leadership and capability building in law and justice

The aim of this project was to create a model mapping the scaffolding and development of: peer leadership opportunities and capacity; and graduate capabilities, work-related skills and outcomes, across the range of peer assisted learning programs offered in the Faculty of Law during 2013. In doing so, it conceptualised Law and Justice students’ roles and opportunities for peer leadership across the whole of their learning experience and aimed to raise awareness of the benefits to leaders of participating in peer programs (relevant to the development of their graduate capabilities and employability). Through the mapping, the project also sought to increase student understanding of the range of peer leader opportunities available across the Faculty and therefore promote participation in such programs.

Adolescent peer aggression and its association with mental health and substance use in an Australian cohort

Prospective longitudinal birth cohort data was used to examine the association between peer aggression at 14 years and mental health and substance use at 17 years. A sample of 1590 participants from the Western Australian Pregnancy Cohort (Raine) study were divided into mutually exclusive categories (victims, perpetrators, victim-perpetrators and uninvolved). Involvement in any type of peer aggression as a victim (10.1%), perpetrator (21.4%), or a victim-perpetrator (8.7%) was reported by 40.2% of participants. After adjusting for confounding factors, those who were a victim of peer aggression had increased odds of later depression and internalising symptoms whilst perpetrators of peer aggression were found to be at increased risk of depression and harmful alcohol use. Victim-perpetrators of peer aggression were more likely to have externalising behaviours at 17 years. These results show an independent temporal relationship between peer aggression and later mental health and substance use problems in adolescence.

Streamlined research funding using short proposals and accelerated peer review : an observational study

Background Despite the widely recognised importance of sustainable health care systems, health services research remains generally underfunded in Australia. The Australian Centre for Health Services Innovation (AusHSI) is funding health services research in the state of Queensland. AusHSI has developed a streamlined protocol for applying and awarding funding using a short proposal and accelerated peer review. Method An observational study of proposals for four health services research funding rounds from May 2012 to November 2013. A short proposal of less than 1,200 words was submitted using a secure web-based portal. The primary outcome measures are: time spent preparing proposals; a simplified scoring of grant proposals (reject, revise or accept for interview) by a scientific review committee; and progressing from submission to funding outcomes within eight weeks. Proposals outside of health services research were deemed ineligible. Results There were 228 eligible proposals across 4 funding rounds: from 29% to 79% were shortlisted and 9% to 32% were accepted for interview. Success rates increased from 6% (in 2012) to 16% (in 2013) of eligible proposals. Applicants were notified of the outcomes within two weeks from the interview; which was a maximum of eight weeks after the submission deadline. Applicants spent 7 days on average preparing their proposal. Applicants with a ranking of reject or revise received written feedback and suggested improvements for their proposals, and resubmissions composed one third of the 2013 rounds. Conclusions The AusHSI funding scheme is a streamlined application process that has simplified the process of allocating health services research funding for both applicants and peer reviewers. The AusHSI process has minimised the time from submission to notification of funding outcomes.

The QUT Training Model for Peer Leader Capacity Building

QUT has enacted a university-wide Peer Program’s Strategy which aims to improve student success and graduate outcomes. A component of this strategy is a training model providing relevant, quality-assured and timely training for all students who take on leadership roles. The training model is designed to meet the needs of the growing scale and variety of peer programs, and to recognise the multiple roles and programs in which students may be involved during their peer leader journey. The model builds peer leader capacity by offering centralised, beginning and ongoing training modules, delivered by in-house providers, covering topics which prepare students to perform their role safely, inclusively, accountably and skilfully. The model also provides efficiencies by differentiating between ‘core competency' and ‘program-specific’ modules, thus avoiding training duplication across multiple programs, and enabling training to be individually and flexibly formatted to suit the specific and unique needs of each program.

Peer Leader Roles Descriptors

Across QUT there are a spectrum of peer-to-peer programs and activities initiated by both staff and students that have been designed to build the capacity of all students to ensure they reach their full learning potential. Peer leader roles have in common a focus on building students' sense of belonging to the university, and in doing so, boosting their confidence as learners and capacity to succeed academically. This document provides a set of descriptors that provides details of the various peer leader roles across QUT and their associated responsibilities.

Personas of students accessing a peer-facilitated support for learning program

STIMulate is a support for learning program at the Queensland University of Technology in Brisbane, Australia. The program provides assistance in mathematics, science and information technology for undergraduate students. This paper develops personas - archetypal users - that represent the attitudes and motivations of students that utilise STIMulate (in particular, the IT stream). Seven different personas were developed based on interviews gathered from Peer Learning Facilitators (PLF) who are experienced students that have excelled in relevant subject areas. The personas were then validated by a PLF focus group. Developing the personas enabled us to better understand the characteristics and needs of the students using the STIMulate program, enabling a more critical analysis of the quality of the service provided.

Facebook: A basis for forming a peer learning community for nursing students in a bioscience unit

First year nursing students commonly find bioscience to be challenging. A Facebook community site was established to support and engage these students. The site was facilitated by virtual peer mentors and the unit coordinator. The high participation rate and the strong recommendation to future students indicated that the site successfully enabled student interaction and engagement with their learning. The students found it to be a readily accessible network and valued the useful resources and learning strategies provided by their peers. The sharing of both learning challenges and successful learning practices can help students build a sense of belonging and an understanding of academic practices and behaviours that can contribute to their learning success at university.

The peer leader capacity building model: A student learning journey

The benefits of peer leader experiences in building graduate skills and capabilities, is well documented and recognised in the higher education sector (Ender & Kay, 2001; Lindsey, Weiler, Zarich, Haddock, Krafchick, & Zimmerman, 2014; Shook & Keup, J., 2012). While benefits are acknowledged, responsibility for identifying, structuring and recording the learning experiences and learning outcomes is charged to the student. This poster describes a framework ‘The Peer Leader Capacity Building Model’ that purposefully structures the peer-leader’s learning journey providing: timely training, moments of critical reflection and goal setting. The model articulates the fundamental interplay of learning and peer leader service which forms the peer ‘learnership’. The journey begins with the ‘aspiration’ phase where students come to understand their leadership opportunities, progressing through ‘enabling’ and ‘mastering’ phases where students shape their learner-leader experience, and finally, to the ‘contributing graduate’ phase where students emerge as competent graduates able to confidently participate in their communities and workplaces. In shifting from a program centric approach that priorities the needs of the mentees, the Peer Leader Capacity Building Model focuses on the individual as a peer leader encouraging the student to shape their individual ‘learnscape’ through consciously navigating both their curricula and co-curricular learning experiences.

Regulating ride-sharing in the peer economy

The rise of the peer economy poses complex new regulatory challenges for policy-makers. The peer economy, typified by services like Uber and AirBnB, promises substantial productivity gains through the more efficient use of existing resources and a marked reduction in regulatory overheads. These services are rapidly disrupting existing established markets, but the regulatory trade-offs they present are difficult to evaluate. In this paper, we examine the peer economy through the context of ride-sharing and the ongoing struggle over regulatory legitimacy between the taxi industry and new entrants Uber and Lyft. We first sketch the outlines of ride-sharing as a complex regulatory problem, showing how questions of efficiency are necessarily bound up in questions about levels of service, controls over pricing, and different approaches to setting, upholding, and enforcing standards. We outline the need for data-driven policy to understand the way that algorithmic systems work and what effects these might have in the medium to long term on measures of service quality, safety, labour relations, and equality. Finally, we discuss how the competition for legitimacy is not primarily being fought on utilitarian grounds, but is instead carried out within the context of a heated ideological battle between different conceptions of the role of the state and private firms as regulators. We ultimately argue that the key to understanding these regulatory challenges is to develop better conceptual models of the governance of complex systems by private actors and the available methods the state has of influencing their actions. These struggles are not, as is often thought, struggles between regulated and unregulated systems. The key to understanding these regulatory challenges is to better understand the important regulatory work carried out by powerful, centralised private firms – both the incumbents of existing markets and the disruptive network operators in the peer-economy.

Regulating ride-sharing in the peer economy

The rise of the peer economy poses complex new regulatory challenges for policy-makers. The peer economy, typified by services like Uber and AirBnB, promises substantial productivity gains through the more efficient use of existing resources and a marked reduction in regulatory overheads. These services are rapidly disrupting existing established markets, but the regulatory trade-offs they present are difficult to evaluate. In this paper, we examine the peer economy through the context of ride-sharing and the ongoing struggle over regulatory legitimacy between the taxi industry and new entrants Uber and Lyft. We first sketch the outlines of ride-sharing as a complex regulatory problem, showing how questions of efficiency are necessarily bound up in questions about levels of service, controls over pricing, and different approaches to setting, upholding, and enforcing standards. We outline the need for data-driven policy to understand the way that algorithmic systems work and what effects these might have in the medium to long term on measures of service quality, safety, labour relations, and equality. Finally, we discuss how the competition for legitimacy is not primarily being fought on utilitarian grounds, but is instead carried out within the context of a heated ideological battle between different conceptions of the role of the state and private firms as regulators. We ultimately argue that the key to understanding these regulatory challenges is to develop better conceptual models of the governance of complex systems by private actors and the available methods the state has of influencing their actions. These struggles are not, as is often thought, struggles between regulated and unregulated systems. The key to understanding these regulatory challenges is to better understand the important regulatory work carried out by powerful, centralised private firms – both the incumbents of existing markets and the disruptive network operators in the peer-economy.

Impact of adolescent peer aggression on later educational and employment outcomes in an Australian cohort

This study used prospective birth cohort data to analyse the relationship between peer aggression at 14 years of age and educational and employment outcomes at 17 years (N = 1091) and 20 years (N = 1003). Participants from the Western Australian Pregnancy Cohort (Raine) study were divided into mutually exclusive categories of peer aggression. Involvement in peer aggression was reported by 40.2% (10.1% victims; 21.4% perpetrators; 8.7% victim–perpetrators) of participants. Participants involved in any form of peer aggression were less likely to complete secondary school. Perpetrators and victim–perpetrators of peer aggression were more likely to be in the ‘No Education, Employment or Training’ group at 20 years of age. This association was explained by non-completion of secondary school. These findings demonstrate a robust association between involvement in peer aggression and non-completion of secondary school, which in turn was associated with an increased risk of poor educational and employment outcomes in early adulthood.

Peer mentoring for radiotherapy planning skills development: A pilot study

Introduction: This study aimed to determine the potential role and guidelines for implementation of skill-based peer mentoring for radiotherapy planning education. Methods: After four weekly mentoring sessions, both Year 3 mentors (n=9) and Year 2 mentees (n=9) were invited to complete a short online questionnaire relating to the impact of the initiative. The tool contained a mixture of Likert-style questions concerning student enjoyment and perceived usefulness of the initiative as well as more qualitative open questions that gathered perceptions of the peer mentoring process, implementation methods and potential future scope. Results: Several key discussion themes related to benefits to each stakeholder group, challenges arising, improvements and potential future directions. There were high levels of enjoyment and perceived value of the mentoring from both sides with 100% of the 18 respondents enjoying the experience. The informal format encouraged further learning, while mentors reported acquisition of valuable skills and gains in knowledge. Conclusions: Peer mentoring has a valuable and enjoyable role to play in radiotherapy planning training and helps consolidate theoretical understanding for experienced students. An informal approach allows for students to adopt the most appropriate mentoring model for their needs while providing them with a free space to engender additional discussion.