Scaling up diabetes prevention in Victoria, Australia: policy development, implementation and evaluation

Objective
The Australian lifestyle intervention program Life! is only the second reported, large-scale diabetes prevention program. This paper describes the genesis and the successful establishment of Life! and its key outcomes for participants and implementation.

Research
Design and Methods Life!, a behavior change intervention, comprises six group sessions over eight months. The Victorian Department of Health funded Diabetes Australia-Victoria to implement the program. Experience of the Greater Green Triangle diabetes prevention implementation trial was used for intervention design, workforce development, training and infrastructure. Clinical and anthropometric data from participants, used for program evaluation, was recorded on a central database.

Results
Life! has a state-wide workforce of 302 trained facilitators within 137 organizations. 29,000 Victorians showed interest in Life! and 15,000 individuals have been referred to the program. In total, 8,412 participants commenced a Life! program between October 2007 and June 2011. 37% of the original participants completed the eight month program. Participants completing sessions one to five lost an average of 1·4 kg weight (p<0·001) and waist circumference of 2·5cm (p<0.001). Those completing six sessions lost an average of 2·4 kg weight (p<0·001) and waist circumference of 3·8 cm (p<0·001). The weight loss of 2.4 kg represents 2.7% of participants’ starting body weight.

Conclusion
The impact of Life! is attributable to applying available evidence for the systems design of the intervention, and collaboration between policy makers, implementers and evaluators using the principles of continuous quality improvement to support successful, large scale recruitment and implementation.

What's important in defining quality of life for older people? An exploratory study of the views of older South Australians

Background
Cost-effectiveness analyses of interventions for older adults have traditionally focused on health status. There is increasing recognition of the need to develop new instruments to capture quality of life in a broader sense in the face of age-associated increasing frailty and declining health status, particularly in the economic evaluation of aged and social care interventions which may have positive benefits beyond health. 

eVALUate: an evaluation instrument for measuring students’ perceptions of their engagement and learning outcomes

In the current climate in Australian higher education, quality assurance in university teaching is a priority. In particular, the introduction of the Learning and Teaching Performance Fund (LTPF) has refocused attention on universities’ internal student evaluation survey instruments. This paper reports the development, validation and implementation of a new unit survey instrument which prompts students to reflect on what helps their achievement of unit learning outcomes, and to report their levels of motivation, engagement and overall satisfaction with a semester‐long course or unit of study. The instrument (eVALUate) was created from precepts reported in the research literature, current practices in evaluating teaching, and sound quality assurance practices appropriate to a university outcomes‐focused education paradigm.

Recombinant human growth hormone for the treatment of growth disorders in children: a systematic review and economic evaluation

Recombinant human growth hormone (rhGH) is licensed for short stature associated with growth hormone deficiency (GHD), Turner syndrome (TS), Prader-Willi syndrome (PWS), chronic renal insufficiency (CRI), short stature homeobox-containing gene deficiency (SHOX-D) and being born small for gestational age (SGA). To assess the clinical effectiveness and cost-effectiveness of rhGH compared with treatment strategies without rhGH for children with GHD, TS, PWS, CRI, SHOX-D and those born SGA. The systematic review used a priori methods. Key databases were searched (e.g. MEDLINE, EMBASE, NHS Economic Evaluation Database and eight others) for relevant studies from their inception to June 2009. A decision-analytical model was developed to determine cost-effectiveness in the UK. Two reviewers assessed titles and abstracts of studies identified by the search strategy, obtained the full text of relevant papers, and screened them against inclusion criteria. Data from included studies were extracted by one reviewer and checked by a second. Quality of included studies was assessed using standard criteria, applied by one reviewer and checked by a second. Clinical effectiveness studies were synthesised through a narrative review. Twenty-eight randomised controlled trials (RCTs) in 34 publications were included in the systematic review. GHD: Children in the rhGH group grew 2.7 cm/year faster than untreated children and had a statistically significantly higher height standard deviation score (HtSDS) after 1 year: -2.3 ± 0.45 versus -2.8 ± 0.45. TS: In one study, treated girls grew 9.3 cm more than untreated girls. In a study of younger children, the difference was 7.6 cm after 2 years. HtSDS values were statistically significantly higher in treated girls. PWS: Infants receiving rhGH for 1 year grew significantly taller (6.2 cm more) than those untreated. Two studies reported a statistically significant difference in HtSDS in favour of rhGH. CRI: rhGH-treated children in a 1-year study grew an average of 3.6 cm more than untreated children. HtSDS was statistically significantly higher in treated children in two studies. SGA: Criteria were amended to include children of 3+ years with no catch-up growth, with no reference to mid-parental height. Only one of the RCTs used the licensed dose; the others used higher doses. Adult height (AH) was approximately 4 cm higher in rhGH-treated patients in the one study to report this outcome, and AH-gain SDS was also statistically significantly higher in this group. Mean HtSDS was higher in treated than untreated patients in four other studies (significant in two). SHOX-D: After 2 years' treatment, children were approximately 6 cm taller than the control group and HtSDS was statistically significantly higher in treated children. The incremental cost per quality adjusted life-year (QALY) estimates of rhGH compared with no treatment were: 23,196 pounds for GHD, 39,460 pounds for TS, 135,311 pounds for PWS, 39,273 pounds for CRI, 33,079 pounds for SGA and 40,531 pounds for SHOX-D. The probability of treatment of each of the conditions being cost-effective at 30,000 pounds was: 95% for GHD, 19% for TS, 1% for PWS, 16% for CRI, 38% for SGA and 15% for SHOX-D.

The clinical effectiveness and cost-effectiveness of bariatric (weight loss) surgery for obesity: a systematic review and economic evaluation

To assess the clinical effectiveness and cost-effectiveness of bariatric surgery for obesity. Seventeen electronic databases were searched [MEDLINE; EMBASE; PreMedline In-Process & Other Non-Indexed Citations; The Cochrane Library including the Cochrane Systematic Reviews Database, Cochrane Controlled Trials Register, DARE, NHS EED and HTA databases; Web of Knowledge Science Citation Index (SCI); Web of Knowledge ISI Proceedings; PsycInfo; CRD databases; BIOSIS; and databases listing ongoing clinical trials] from inception to August 2008. Bibliographies of related papers were assessed and experts were contacted to identify additional published and unpublished references. Two reviewers independently screened titles and abstracts for eligibility. Inclusion criteria were applied to the full text using a standard form. Interventions investigated were open and laparoscopic bariatric surgical procedures in widespread current use compared with one another and with non-surgical interventions. Population comprised adult patients with body mass index (BMI) > or = 30 and young obese people. Main outcomes were at least one of the following after at least 12 months follow-up: measures of weight change; quality of life (QoL); perioperative and postoperative mortality and morbidity; change in obesity-related comorbidities; cost-effectiveness. Studies eligible for inclusion in the systematic review for comparisons of Surgery versus Surgery were RCTs. For comparisons of Surgery versus Non-surgical procedures eligible studies were RCTs, controlled clinical trials and prospective cohort studies (with a control cohort). Studies eligible for inclusion in the systematic review of cost-effectiveness were full cost-effectiveness analyses, cost-utility analyses, cost-benefit analyses and cost-consequence analyses. One reviewer performed data extraction, which was checked by two reviewers independently. Two reviewers independently applied quality assessment criteria and differences in opinion were resolved at each stage. Studies were synthesised through a narrative review with full tabulation of the results of all included studies. In the economic model the analysis was developed for three patient populations, those with BMI > or = 40; BMI > or = 30 and < 40 with Type 2 diabetes at baseline; and BMI > or = 30 and < 35. Models were applied with assumptions on costs and comorbidity.

A methodological approach to quality assurance of programs in an independent school

This paper reports on ways in which one Australian independent school seeks to develop and sustain best practice and academic integrity in its programs through a quality assurance system of ongoing program reviews, and findings of a study that we conducted into staff perceptions of the different program reviews. First, we outline the overarching methodological and conceptual approaches used in the school’s program reviews. Second, we present and discuss the findings of the study.

The systematic influences on student evaluation of teaching in engineering education

BACKGROUND Student evaluation of teaching (SET) has a long history, has grown in prevalence and importance over a period of decades, and is now common-place in many universities internationally. SET data are collected for a range of purposes, including: as diagnostic feedback to improve the quality of teaching and learning; as an input to staff performance management processes and personnel decisions such as promotion for staff; to provide information to prospective students in their selection of courses and programs; and as a source of data for research on teaching. Rovai et al. (2006) report that while SET research provides mixed results, there is evidence that, for course-related factors, smaller classes are rated more favourably than large classes, upper-year-level classes are rated more favourably than lower-year classes, and that there are rating differences between discipline areas. While additional course-related factors are also noted, other reviews of the literature on SET also identify these three factors as commonly reported systematic influences on SET ratings. The School of Engineering at Deakin University in Australia offers undergraduate and postgraduate engineering programs, and these programs are delivered in both on-campus and off-campus modes.PURPOSEThe paper presents a quantitative investigation of SET data for the School of Engineering at Deakin University to identify whether the commonly reported systematic influences on SET ratings of class size and year level are also observed here. The influence of online mode of offer is also explored.DESIGN/METHOD Deakin University’s Student Evaluation of Teaching and Units (SETU) questionnaire is administered to students enrolled in every unit of study every time that unit is offered, unless it is specially exempted. Following data collation, summary results are reported via a public website. The publicly available SETU data for all School of Engineering units of study were collected for a two year period. The collected data were subjected to analysis of variance (ANOVA) analysis to identify any significant systematic influences on mean student SETU ratings.RESULTS SETU data from 100 separate units of study over the two year period were collected, representing 3375 sets of SETU ratings, and covering unit enrolment sizes from 12 to 462 students. Although this was a modest sized investigation, significantly higher mean ratings for some SETU items were observed for units with small enrolments, for postgraduate level units compared to undergraduate level units, and for units offered in conventional mode compared to online mode of offer. The presence of the commonly observed systematic influences on SET ratings was confirmed.CONCLUSIONS While the use of SET data may have originally been primarily for formative purposes to improve teaching and learning, they are also increasingly used for summative judgements of teaching quality and teaching staff performance that have implications for personnel decision making. There may be an acceptance of the need for SET, however there remains no universal consensus as to what constitutes quality in university teaching and learning, and the increasing use of SET for high-stakes decision making puts pressure on institutions to ensure that their SET practices are sound, equitable and defensible.

Evaluation of University of Queensland Library Spaces: three case studies at St Lucia Campus

Introduction: The paper reports on an evaluation study of spaces in the Social Sciences and Humanities (SSHL), Biological Sciences (BSL) and Walter Harrison Law (WHLL) Libraries of the University of Queensland (UQ). The study was part of an evaluation of the quality and patterns of use of spaces in UQ libraries, which aimed to propose recommendations for future improvements and decision-making. This paper presents a study of areas of weakness in existing SSHL spaces, and impacts of the refurbishment of spaces at BSL and WHLL on students’ experiences. The findings evidence a link between students’ learning experiences and the quality of library spaces.Methods: An online survey, “Students’ Experiences and Perceptions of Library Physical Spaces”, was designed to collect data from students. The survey questions addressed seven topics: (1) overall satisfaction with spaces in the UQ Libraries; (2) welcoming nature of the library entry; (3) lighting; (4) acoustics; (5) furniture; (6) wayfinding; and (7) preferences for different space types in the library.Results: 1505 students completed the surveys, with 1098 responses recorded to open-ended questions on why students visited the libraries and the physical characteristics of the spaces that influenced their experiences. Quantitative and qualitative analysis of the data elucidated key design challenges and considerations. In particular, the data suggested that the provision of individual quiet study spaces remains an important role of academic libraries, with Studying Alone identified as the most important reason for student visits.Conclusions: The findings highlight the importance of individual study spaces and propose a number of recommendations in relation to physical space design and management.Relevance: Academic libraries face the challenge to keep pace with change in relation to students’ demographics, pedagogy and technology. In doing so, it is important to have an understanding of the evolving patterns of students’ learning behaviours, space uses and preferences through ongoing evaluation of library spaces.

A new computerized adaptive test advancing the measurement of health-related quality of life (HRQoL) in children: the Kids-CAT

Purpose: Assessing health-related quality of life (HRQoL) via Computerized Adaptive Tests (CAT) provides greater measurement precision coupled with a lower test burden compared to conventional tests. Currently, there are no European pediatric HRQoL CATs available. This manuscript aims at describing the development of a HRQoL CAT for children and adolescents: the Kids-CAT, which was developed based on the established KIDSCREEN-27 HRQoL domain structure. Methods: The Kids-CAT was developed combining classical test theory and item response theory methods and using large archival data of European KIDSCREEN norm studies (n = 10,577–19,580). Methods were applied in line with the US PROMIS project. Item bank development included the investigation of unidimensionality, local independence, exploration of Differential Item Functioning (DIF), evaluation of Item Response Curves (IRCs), estimation and norming of item parameters as well as first CAT simulations. Results: The Kids-CAT was successfully built covering five item banks (with 26–46 items each) to measure physical well-being, psychological well-being, parent relations, social support and peers, and school well-being. The Kids-CAT item banks proved excellent psychometric properties: high content validity, unidimensionality, local independence, low DIF, and model conform IRCs. In CAT simulations, seven items were needed to achieve a measurement precision between.8 and.9 (reliability). It has a child-friendly design, is easy accessible online and gives immediate feedback reports of scores. Conclusions: The Kids-CAT has the potential to advance pediatric HRQoL measurement by making it less burdensome and enhancing the patient–doctor communication.

Erratum to: A new computerized adaptive test advancing the measurement of health-related quality of life (HRQoL) in children: the Kids-CAT

Abstract
Purpose
Assessing health-related quality of life (HRQoL) via Computerized Adaptive Tests (CAT) provides greater measurement precision coupled with a lower test burden compared to conventional tests. Currently, there are no European pediatric HRQoL CATs available. This manuscript aims at describing the development of a HRQoL CAT for children and adolescents: the Kids-CAT, which was developed based on the established KIDSCREEN-27 HRQoL domain structure.
Methods
The Kids-CAT was developed combining classical test theory and item response theory methods and using large archival data of European KIDSCREEN norm studies (n=10,577–19,580). Methods were applied in line with the US PROMIS project. Item bank development included the investigation of unidimensionality, local independence, exploration of Differential Item Functioning (DIF), evaluation of Item Response Curves (IRCs), estimation and norming of item parameters as well as first CAT simulations.
Results
The Kids-CAT was successfully built covering five item banks (with 26–46 items each) to measure physical well-being, psychological well-being, parent relations, social support and peers, and school well-being. The Kids-CAT item banks proved excellent psychometric properties: high content validity, unidimensionality, local independence, low DIF, and model conform IRCs. In CAT simulations, seven items were needed to achieve a measurement precision between .8 and .9 (reliability). It has a child-friendly design, is easy accessible online and gives immediate feedback reports of scores.
Conclusions
The Kids-CAT has the potential to advance pediatric HRQoL measurement by making it less burdensome and enhancing the patient–doctor communication.

Mental health first aid training for Australian medical and nursing students: an evaluation study

BACKGROUND: The role and demands of studying nursing and medicine involve specific stressors that may contribute to an increased risk for mental health problems. Stigma is a barrier to help-seeking for mental health problems in nursing and medical students, making these students vulnerable to negative outcomes including higher failure rates and discontinuation of study. Mental Health First Aid (MHFA) is a potential intervention to increase the likelihood that medical and nursing students will support their peers to seek help for mental health problems. This study aimed to evaluate the effectiveness of a tailored MHFA course for nursing and medical students.

METHODS: Nursing and medical students self-selected into either a face-to-face or online tailored MHFA course. Four hundred and thirty-four nursing and medical students completed pre- and post-course surveys measuring mental health first aid intentions, mental health literacy, confidence in providing help, stigmatising attitudes and satisfaction with the course.

RESULTS: The results of the study showed that both the online and face-to-face courses improved the quality of first aid intentions towards a person experiencing depression, and increased mental health literacy and confidence in providing help. The training also decreased stigmatizing attitudes and desire for social distance from a person with depression.

CONCLUSION: Both online and face-to-face tailored MHFA courses have the potential to improve outcomes for students with mental health problems, and may benefit the students in their future professional careers.

Understanding feedback report uptake: process evaluation findings from a 13-month feedback intervention in long-term care settings

BACKGROUND: Long-term care settings provide care to a large proportion of predominantly older, highly disabled adults across the United States and Canada. Managing and improving quality of care is challenging, in part because staffing is highly dependent on relatively non-professional health care aides and resources are limited. Feedback interventions in these settings are relatively rare, and there has been little published information about the process of feedback intervention. Our objectives were to describe the key components of uptake of the feedback reports, as well as other indicators of participant response to the intervention. METHODS: We conducted this project in nine long-term care units in four facilities in Edmonton, Canada. We used mixed methods, including observations during a 13-month feedback report intervention with nine post-feedback survey cycles, to conduct a process evaluation of a feedback report intervention in these units. We included all facility-based direct care providers (staff) in the feedback report distribution and survey administration. We conducted descriptive analyses of the data from observations and surveys, presenting this in tabular and graphic form. We constructed a short scale to measure uptake of the feedback reports. Our analysis evaluated feedback report uptake by provider type over the 13 months of the intervention. RESULTS: We received a total of 1,080 survey responses over the period of the intervention, which varied by type of provider, facility, and survey month. Total number of reports distributed ranged from 103 in cycle 12 to 229 in cycle 3, although the method of delivery varied widely across the period, from 12% to 65% delivered directly to individuals and 15% to 84% left for later distribution. The key elements of feedback uptake, including receiving, reading, understanding, discussing, and reporting a perception that the reports were useful, varied by survey cycle and provider type, as well as by facility. Uptake, as we measured it, was consistently high overall, but varied widely by provider type and time period. CONCLUSIONS: We report detailed process data describing the aspects of uptake of a feedback report during an intensive, longitudinal feedback intervention in long-term care facilities. Uptake is a complex process for which we used multiple measures. We demonstrate the feasibility of conducting a complex longitudinal feedback intervention in relatively resource-poor long-term care facilities to a wider range of provider types than have been included in prior feedback interventions.

Evaluation of a comprehensive interactive training system for investigative interviewers of children

This article reports on the evaluation of an interactive interviewer training system with a large, heterogeneous sample of investigative interviewers of children. The system, delivered predominantly through computer-assisted learning activities, focused on how to elicit important evidential details from child witnesses in a narrative format. Two studies are reported, each adopting a pre-versus posttraining design. Study 1 examined the effect of the training on trainees' (N = 92) performance, using mock interviews where an actor played the role of the child in a highly controlled manner. Study 2 examined the effect of the training on field interviews (N = 156) conducted prior to and after the training. Five measures were analyzed: (a) proportion of interviewer question types, (b) proportion of desirable interviewer behaviors, (c) adherence to the interview protocol, (d) interview length, and (e) the quality of evidential information sought. Overall, the findings provide clear support for the utility of the training system. Irrespective of the type of interview or measure, adherence to best-practice interviewing increased from pre- to posttraining, with some evidence supporting sustained performance 12 months after there had been no intervening training or supervision. The implication is that there is now an evidence-based alternative to the traditional classroom-based training system for investigative interviewers. Suggestions for future research are also discussed.

A systematic evaluation of field-based screening methods for the assessment of anterior cruciate ligament (ACL) injury risk

BACKGROUND: Laboratory-based measures provide an accurate method to identify risk factors for anterior cruciate ligament (ACL) injury; however, these methods are generally prohibitive to the wider community. Screening methods that can be completed in a field or clinical setting may be more applicable for wider community use. Examination of field-based screening methods for ACL injury risk can aid in identifying the most applicable method(s) for use in these settings. OBJECTIVE: The objective of this systematic review was to evaluate and compare field-based screening methods for ACL injury risk to determine their efficacy of use in wider community settings. DATA SOURCES: An electronic database search was conducted on the SPORTDiscus™, MEDLINE, AMED and CINAHL databases (January 1990-July 2015) using a combination of relevant keywords. A secondary search of the same databases, using relevant keywords from identified screening methods, was also undertaken. STUDY SELECTION: Studies identified as potentially relevant were independently examined by two reviewers for inclusion. Where consensus could not be reached, a third reviewer was consulted. Original research articles that examined screening methods for ACL injury risk that could be undertaken outside of a laboratory setting were included for review. STUDY APPRAISAL AND SYNTHESIS METHODS: Two reviewers independently assessed the quality of included studies. Included studies were categorized according to the screening method they examined. A description of each screening method, and data pertaining to the ability to prospectively identify ACL injuries, validity and reliability, recommendations for identifying 'at-risk' athletes, equipment and training required to complete screening, time taken to screen athletes, and applicability of the screening method across sports and athletes were extracted from relevant studies. RESULTS: Of 1077 citations from the initial search, a total of 25 articles were identified as potentially relevant, with 12 meeting all inclusion/exclusion criteria. From the secondary search, eight further studies met all criteria, resulting in 20 studies being included for review. Five ACL-screening methods-the Landing Error Scoring System (LESS), Clinic-Based Algorithm, Observational Screening of Dynamic Knee Valgus (OSDKV), 2D-Cam Method, and Tuck Jump Assessment-were identified. There was limited evidence supporting the use of field-based screening methods in predicting ACL injuries across a range of populations. Differences relating to the equipment and time required to complete screening methods were identified. LIMITATIONS: Only screening methods for ACL injury risk were included for review. Field-based screening methods developed for lower-limb injury risk in general may also incorporate, and be useful in, screening for ACL injury risk. CONCLUSIONS: Limited studies were available relating to the OSDKV and 2D-Cam Method. The LESS showed predictive validity in identifying ACL injuries, however only in a youth athlete population. The LESS also appears practical for community-wide use due to the minimal equipment and set-up/analysis time required. The Clinic-Based Algorithm may have predictive value for ACL injury risk as it identifies athletes who exhibit high frontal plane knee loads during a landing task, but requires extensive additional equipment and time, which may limit its application to wider community settings.