Including or excluding conflicts of interest among expert peer reviewers had little impact on funding success, a case study from Australia

Competition for research funding is intense and the opinions of an expert peer reviewer can mean the difference between success and failure in securing funding. The allocation of expert peer reviewers is therefore vitally important and funding agencies strive to avoid using reviewers who have real or perceived conflicts of interest. This article examines the impact of including or excluding peer reviewers based on their conflicts of interest, and the final ranking of funding proposals. Two 7-person review panels assessed a sample of National Health and Medical Research Council (NHMRC) of Australia proposals in Basic Science or Public Health. Using a pre-post comparison, the proposals were first scored after the exclusion of reviewers with a high or medium conflict, and re-scored after the return of reviewers with medium conflicts. The main outcome measures are the agreements in ranks and funding success before and after excluding the medium conflicts. Including medium conflicts of interest had little impact on the ranks or funding success. The Bland–Altman 95% limits of agreement were ± 3.3 ranks and ± 3.4 ranks in the two panels which both assessed 36 proposals. Overall there were three proposals (4%) that had a reversed funding outcome after including medium conflicts. Relaxing the conflict of interest rules would increase the number of expert reviewers included in the panel discussions which could increase the quality of peer review and make it easier to find reviewers.

Introduction to the Proceedings of the 1st EDOC 2009 Workshop on Service-Oriented Business Networks and Ecosystems (SOBNE '09)

The first Workshop on Service-Oriented Business Networks and Ecosystems (SOBNE ’09) is held in conjunction with the 13th IEEE International EDOC Conference on 2 September 2009 in Auckland, New Zealand. The SOBNE ’09 program includes 9 peer-reviewed papers (7 full and 2 short papers) and an open discussion session. This introduction to the Proceedings of SOBNE ’09 starts with a brief background of the motivation for the workshop. Next, it contains a short description of the peer-reviewed papers, and finally, after some concluding statements and the announcement of the winners of the Best Reviewer Award and the Most Promising Research Award, it lists the members of the SOBNE ’09 Program Committee and external reviewers of the workshop submissions.

Thinking Collaboratively about the Peer-Review Process for Journal- Article Publication

In this conversation, Kevin K. Kumashiro shares his reflections on challenges to publishing anti-oppressive research in educational journals. He then invites eight current and former editors of leading educational research journals--William F. Pinar, Elizabeth Graue, Carl A. Grant, Maenette K. P. Benham, Ronald H. Heck, James Joseph Scheurich, Allan Luke, and Carmen Luke--to critique and expand on his analysis. Kumashiro begins the conversation by describing his own experiences submitting manuscripts to educational research journals and receiving comments by anonymous reviewers and journal editors. He suggests three ways to rethink the collaborative potential of the peer-review process: as constructive, as multilensed, and as situated. The eight current and former editors of leading educational research journals then critique and expand Kumashiro's analysis. Kumashiro concludes the conversation with additional reflections on barriers and contradictions involved in advancing anti-oppressive educational research in educational journals. (Contains 3 notes.)

Interventions for preventing and managing aggressive patients admitted to an acute hospital setting: A systematic review

Background: Violence in health care has been widely reported and health care workers, particularly nurses in acute care settings, are ill-equipped to manage patients who exhibit aggressive traits. Aim: The aim of this systematic review was to establish best practice in the prevention and management of aggressive behaviours in patients admitted to acute hospital settings. Data Sources: An extensive search of the major databases was conducted from 1990 to 2007. The search included published and unpublished studies and papers in English. Review Methods: This review considered any quantitative research study design that evaluated the effectiveness of interventions in the prevention and management of patients who exhibit aggressive behaviours in an acute hospital setting. Each included study was quality assessed by two independent reviewers and data were extracted using the relevant tools developed by the Joanna Briggs Institute. Results: Ten studies met the inclusion criteria and were included in the review. The evidence identified from the studies includes: the benefit of education and training of acute care nurses in aggression management techniques; use of “as required” medications is effective in minimising harm to patients and staff; and that specific interventions such as physical restraint may play a role in managing aggressive behaviours from patients in the acute care setting. Conclusions: This review makes several recommendations for the prevention and management of aggressive behaviours in acute hospital patients. However, due to the lack of high-quality studies conducted in the acute care setting there is huge scope for future research in this area.

Peer-to-Patent Australia: First Anniversary Report, December 2010

Peer-to-Patent Australia will initially run as a 12 month pilot project designed to test whether an open community of reviewers can effectively locate prior art that might not otherwise be located by the patent office during a typical examination. Patent applications will be made available for peer review for a period of 6 months and there will follow a 6 month period of joint qualitative and quantitative assessment of the pilot project by IP Australia and QUT. The objective of Peer-to-Patent Australia is to improve the patent examination process and the quality of issued patents by utilising the knowledge and skills of experts in the broader community. It is a way of linking the scientific and technical expertise of anyone with an Internet connection with the expertise of a patent examiner. That community participation consists of members of the public reviewing patent applications and contributing relevant prior art references and comments within a web-based forum. The aim is to bring to light prior art, particularly non-patent prior art, that might otherwise not be identified by patent examiners. The better the prior art resources a patent examiner has at his or her disposal, the more likely a patent application will be assessed properly in terms of novelty and inventive step. The role of Peer-to-Patent Australia in this regard is to act as both a facilitator of discussion and a collector of prior art submissions. Peer-to-Patent Australia collects relevant prior art references on behalf of the reviewing community and forwards that prior art to IP Australia. Section 27 of the Patents Act 1990 (Cth) allows for the Commissioner of Patents to receive submissions of prior art by third parties relevant to the novelty and inventiveness of a particular patent application.

Which components of heart failure programs are effective? A meta-analysis of the outcomes of structured telephone support or telemonitoring as the primary component of heart failure management in 9,560 patients (Abridged Cochrane Review)

Aims--Telemonitoring (TM) and structured telephone support (STS) have the potential to deliver specialised management to more patients with chronic heart failure (CHF), but their efficacy is still to be proven. Objectives To review randomised controlled trials (RCTs) of TM or STS on all- cause mortality and all-cause and CHF-related hospitalisations in patients with CHF, as a non-invasive remote model of specialised disease-management intervention.--Methods and Results--Data sources:We searched 15 electronic databases and hand-searched bibliographies of relevant studies, systematic reviews, and meeting abstracts. Two reviewers independently extracted all data. Study eligibility and participants: We included any randomised controlled trials (RCT) comparing TM or STS to usual care of patients with CHF. Studies that included intensified management with additional home or clinic visits were excluded. Synthesis: Primary outcomes (mortality and hospitalisations) were analysed; secondary outcomes (cost, length of stay, quality of life) were tabulated.--Results: Thirty RCTs of STS and TM were identified (25 peer-reviewed publications (n=8,323) and five abstracts (n=1,482)). Of the 25 peer-reviewed studies, 11 evaluated TM (2,710 participants), 16 evaluated STS (5,613 participants) and two tested both interventions. TM reduced all-cause mortality (risk ratio (RR 0•66 [95% CI 0•54-0•81], p<0•0001) and STS showed similar trends (RR 0•88 [95% CI 0•76-1•01], p=0•08). Both TM (RR 0•79 [95% CI 0•67-0•94], p=0•008) and STS (RR 0•77 [95% CI 0•68-0•87], p<0•0001) reduced CHF-related hospitalisations. Both interventions improved quality of life, reduced costs, and were acceptable to patients. Improvements in prescribing, patient-knowledge and self-care, and functional class were observed.--Conclusion: TM and STS both appear effective interventions to improve outcomes in patients with CHF.

The Foot Heath Status Questionnaire : correct scale score calculation

This letter is in response to the recently published article “Evaluation of two self-referent foot health instruments” by Robert Trevethan (RT) and is in regard to the scale scores he derived when using the quality of life measure, the Foot Health Status Questionnaire [1]. Unfortunately, the journal reviewers and editor did not identify, or address, a fundamental flaw in the methodology of this paper. Subsequently, the inference drawn from this paper could, in all reasonableness, mislead the reader

Peer state assessment of TxDOT maintenance program and practices : workshop and road rally findings

In an effort to evaluate and improve their practices to ensure the future excellence of the Texas highway system, the Texas Department of Transportation (TxDOT) sought a forum in which experts from other state departments of transportation could share their expertise. Thus, the Peer State Review of TxDOT Maintenance Practices project was organized and conducted for TxDOT by the Center for Transportation Research (CTR) at The University of Texas at Austin. The goal of the project was to conduct a workshop at CTR and in the Austin District that would educate the visiting peers on TxDOT’s maintenance practices and invite their feedback. CTR and TxDOT arranged the participation of the following directors of maintenance: Steve Takigawa, CA; Roy Rissky, KS; Eric Pitts, GA; Jim Carney, MO; Jennifer Brandenburg, NC; and David Bierschbach, WA. One of the means used to capture the peer reviewers’ opinions was a carefully designed booklet of 15 questions. The peers provided TxDOT with written responses to these questions, and the oral comments made during the workshop were also captured. This information was then compiled and summarized in the following report. An examination of the peers’ comments suggests that TxDOT should use a more holistic, statewide approach to funding and planning rather than funding and planning for each district separately. Additionally, the peers stressed the importance of allocating funds based on the actual conditions of the roadways instead of on inventory. The visiting directors of maintenance also recommended continuing and proliferating programs that enhance communication, such as peer review workshops.

Comparing cost uplift in infrastructure delivery methods : a case based approach

In 2009 the Australian Federal and State governments are expected to have spent some AU$30 billion procuring infrastructure projects. For governments with finite resources but many competing projects, formal capital rationing is achieved through use of Business Cases. These Business cases articulate the merits of investing in particular projects along with the estimated costs and risks of each project. Despite the sheer size and impact of infrastructure projects, there is very little research in Australia, or internationally, on the performance of these projects against Business Case assumptions when the decision to invest is made. If such assumptions (particularly cost assumptions) are not met, then there is serious potential for the misallocation of Australia’s finite financial resources. This research addresses this important gap in the literature by using combined quantitative and qualitative research methods, to examine the actual performance of 14 major Australian government infrastructure projects. The research findings are controversial as they challenge widely held perceptions of the effectiveness of certain infrastructure delivery practices. Despite this controversy, the research has had a significant impact on the field and has been described as ‘outstanding’ and ‘definitive’ (Alliancing Association of Australasia), "one of the first of its kind" (Infrastructure Partnerships of Australia) and "making a critical difference to infrastructure procurement" (Victorian Department of Treasury). The implications for practice of the research have been profound and included the withdrawal by Government of various infrastructure procurement guidelines, the formulation of new infrastructure policies by several state governments and the preparation of new infrastructure guidelines that substantially reflect the research findings. Building on the practical research, a more rigorous academic investigation focussed on the comparative cost uplift of various project delivery strategies was submitted to Australia’s premier academic management conference, the Australian and New Zealand Academy of Management (ANZAM) Annual Conference. This paper has been accepted for the 2010 ANZAM National Conference following a process of double blind peer review with reviewers rating the paper’s overall contribution as "Excellent" and "Good".

Peer state assessment of TxDOT maintenance program and practices, part I : workshop findings and recommendations

To assess and improve their practices, and thus ensure the future excellence of the Texas highway system, the Texas Department of Transportation (TxDOT) sought a forum in which experts from other State Departments of Transportation could evaluate the TxDOT maintenance program and practices based on their expertise. To meet this need, a Peer State Review of TxDOT Maintenance Practices project was organized and conducted by the Center for Transportation Research (CTR) at The University of Texas at Austin. CTR researchers, along with TxDOT staff, conducted a workshop to present TxDOT’s maintenance practices to the visiting peer reviewers and invite their feedback. Directors of maintenance from six different states—California, Kansas, Georgia, Missouri, North Carolina, and Washington—participated in the workshop. CTR and TxDOT worked together to design a questionnaire with 15 key questions to capture the peers’ opinions on maintenance program and practices. This paper compiles and summarizes this information. The examination results suggested that TxDOT should use a more state-wide approach to funding and planning, in addition to funding and planning for each district separately. Additionally, the peers recommended that criteria such as condition and level of service of the roadways be given greater weight in the funding allocation than lane miles or vehicle miles traveled (VMT). The Peer Reviewers also determined that TxDOT maintenance employee experience and communications were strong assets. Additional strengths included the willingness of TxDOT to invite peer reviews of their practices and a willingness to consider opportunities for improvement.

Should athletes return to sport after applying Ice? A systematic review of the effect of local 3 cooling on functional performance

Applying ice or other forms of topical cooling is a popular method of treating sports injuries. It is commonplace for athletes to return to competitive activity, shortly or immediately after the application of a cold treatment. In this article, we examine the effect of local tissue cooling on outcomes relating to functional performance and to discuss their relevance to the sporting environment. A computerized literature search, citation tracking and hand search was performed up to April, 2011. Eligible studies were trials involving healthy human participants, describing the effects of cooling on outcomes relating to functional performance. Two reviewers independently assessed the validity of included trials and calculated effect sizes. Thirty five trials met the inclusion criteria; all had a high risk of bias. The mean sample size was 19. Meta-analyses were not undertaken due to clinical heterogeneity. The majority of studies used cooling durations >20 minutes. Strength (peak torque/force) was reported by 25 studies with approximately 75% recording a decrease in strength immediately following cooling. There was evidence from six studies that cooling adversely affected speed, power and agility-based running tasks; two studies found this was negated with a short rewarming period. There was conflicting evidence on the effect of cooling on isolated muscular endurance. A small number of studies found that cooling decreased upper limb dexterity and accuracy. The current evidence base suggests that athletes will probably be at a performance disadvantage if they return to activity immediately after cooling. This is based on cooling for longer than 20 minutes, which may exceed the durations employed in some sporting environments. In addition, some of the reported changes were clinically small and may only be relevant in elite sport. Until better evidence is available, practitioners should use short cooling applications and/or undertake a progressive warm up prior to returning to play.

PMI Research and Education Conference 2010

The PMI Research and Education Conference 2010 ended one week ago at the time of this writing. Aside from 3 enlightening keynote speeches, 78 proffered papers were presented. On the basis of the reviewers' assessments, the 10 best papers have been selected to form this special issue...

Compass points : the locations, landscapes and coordinates of identities in contemporary performance making : proceedings of the Australasian Association for Theatre, Drama & Performance Studies (ADSA) Conference 2012

Compass Points: The Locations, Landscapes and Coordinates of Identities' the Australasian Association for Theatre, Drama and Performance Studies (ADSA) Conference 2012 was held at Queensland University of Technology, July 3-6 2012. The Conference was sponsored by the Australasian Association for Theatre, Drama and Performance Studies (ADSA), Queensland University of Technology (QUT), Ian Potter Foundation, Arts Queensland, La Boite Theatre Company and Queensland Theatre Company. The papers selected for this collection represent a small sample of the scope, depth and diversity of scholarship presented at the conference - they cover a range of genres, cultures and contexts in contemporary performance making from autobiography, to playwrighting, to public space performance and beyond. The papers collected have been peer-reviewed to Australia’s Department of Education, Science and Training (DEST) standards - each has been subject to two blind reviews, followed by acceptance, rejection or revision, and editing of accepted papers - by colleagues from Australasia and overseas. The review process for the conference publication was separate from the review process for acceptance of abstracts for the actual conference presentations. The conference convenors, Bree Hadley and Caroline Heim, edited the collection, and would like to thank all those who gave their time to advise on the peer review process and act as reviewers - Tom Burvill, Christine Comans, Sean Edgecomb, Angela Campbell, Natalie Lazaroo, Jo Loth, Meg Mumford, Ulrike Garde, Laura Ginters, Andre Bastian, Sam Trubridge, Delyse Ryan, Georgia Seffrin, Gillian Arrighi, Rand Hazou, Rob Pensalfini, Sue Fenty-Studham, Mark Radvan, Rob Conkie, Kris Plummer, Lisa Warrington, Kate Flaherty, Bryoni Tresize, Janys Hayes, Lisa Warrington, Teresa Izzard, Kim Durban, Veronica Kelly, Adrian Keirnander, James Davenport, Julie Robson and others. We, and the authors, appreciate the rigour and care with which peers have approached the scholarship presented here. This collection was published in final form on July 3rd 2012, the first day of the ADSA Conference 2012.

Managing the production of a Cochrane systematic review

Undertaking a Cochrane systematic review can be an incredibly rewarding experience. It is however a challenging and time-consuming task. The Cochrane Handbook for Systematic Reviews of Interventions1 provides an essential resource to help reviewers navigate the often complex methodological issues of systematic review research. Additional guidelines have been developed for those undertaking reviews of public health topics,2 and Cochrane Centres throughout the world offer invaluable training opportunities. This emphasis on training and methodological rigour has helped Cochrane reviews become one of the most respected sources of synthesized research available. Even with the assistance available, however, many authors with good intentions register titles and prepare protocols but fail to publish the completed review. Data extracted from Cochrane’s Information Management System (Archie) in June 2010 showed that there were 1,301 titles registered more than two years ago that have not been published as a full review.3 Of these registered titles, 697 have had protocols published (25 are no longer active) while 604 have not even progressed to this stage (154 are no longer active). There are also 146 protocols that have been published for more than two years without being converted into completed reviews. These registered titles and protocols that have not yet progressed to a completed review represent a significant amount of time and energy invested by review authors, Cochrane editorial staff and, in some cases, external referees...

Do thermal agents affect range of movement and mechanical properties in soft tissues? A systematic review

OBJECTIVES: To examine the effect of thermal agents on the range of movement (ROM) and mechanical properties in soft tissue and to discuss their clinical relevance. DATA SOURCES: Electronic databases (Cochrane Central Register of Controlled Trials, MEDLINE, and EMBASE) were searched from their earliest available record up to May 2011 using Medical Subjects Headings and key words. We also undertook related articles searches and read reference lists of all incoming articles. STUDY SELECTION: Studies involving human participants describing the effects of thermal interventions on ROM and/or mechanical properties in soft tissue. Two reviewers independently screened studies against eligibility criteria. DATA EXTRACTION: Data were extracted independently by 2 review authors using a customized form. Methodologic quality was also assessed by 2 authors independently, using the Cochrane risk of bias tool. DATA SYNTHESIS: Thirty-six studies, comprising a total of 1301 healthy participants, satisfied the inclusion criteria. There was a high risk of bias across all studies. Meta-analyses were not undertaken because of clinical heterogeneity; however, effect sizes were calculated. There were conflicting data on the effect of cold on joint ROM, accessory joint movement, and passive stiffness. There was limited evidence to determine whether acute cold applications enhance the effects of stretching, and further evidence is required. There was evidence that heat increases ROM, and a combination of heat and stretching is more effective than stretching alone. CONCLUSIONS: Heat is an effective adjunct to developmental and therapeutic stretching techniques and should be the treatment of choice for enhancing ROM in a clinical or sporting setting. The effects of heat or ice on other important mechanical properties (eg, passive stiffness) remain equivocal and should be the focus of future study.