How can the impact of cultural development work in local government be measured? Towards more effective planning and evaluation strategies

The field of cultural development in local government is relatively new, with most councils only having dedicated staff or teams within the last ten to fifteen years. Challenges are associated with that newness in the areas of planning, goal setting and formal evaluation of achievements in relation to goals. How can the best decisions be made about what is needed? How can the outcomes of that work be evaluated? What should be measured and how? This paper explores these challenges and presents some solutions. Program Logic is introduced as a methodology for effective planning and evaluation of cultural development work in local government. The need for both performance and outcome evaluation of cultural development work is discussed, as are the levels of evaluation required; considering the contribution of individual workers, departments, whole of council and the overall community outcomes. Factors beyond the influence of local government, which impact the outcomes of arts initiatives, are also considered in arguing that more sophisticated evaluation processes are required.

A combined impact-process evaluation of a program promoting active transport to school: understanding the factors that shaped program effectiveness

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts.

Adaptation and validation of the Japanese version of the health education impact questionnaire (heiQ-J) for the evaluation of self-management education interventions

Aim:  

Assessment of proximal outcomes of self-management programs : translation and psychometric evaluation of a German version of the Health Education Impact Questionnaire (heiQtm)

Purpose This paper describes the translation, cultural adaption, and psychometric evaluation of a German version of the Health Education Impact Questionnaire (heiQ™), a widely used generic instrument assessing a wide range of proximal outcomes of self-management programs.

Methods The translation was carried out according to international standards and included forward and backward translations. Comprehensibility and content validity were tested using cognitive interviews with 10 rehabilitation inpatients. Psychometric properties were examined in rehabilitation inpatients (n = 1,202) with a range of chronic conditions. Factorial validity was assessed using confirmatory factor analysis; concurrent validity was explored by correlations with comparator scales.

Results The items of the German heiQ™ were well understood by rehabilitation inpatients. The structure of the eight heiQ™ scales was replicated after minor adjustment. heiQ™ scales had higher correlations with comparator scales with similar constructs, particularly mental health concepts than with physical health. Moreover, all heiQ™ scales differentiated between individuals across different levels of depression.

Conclusion The German heiQ™ is comprehensible for German-speaking patients suffering from different types of chronic conditions; it assesses relevant outcomes of self-management programs in a reliable and valid manner. Further studies involving its practical application are warranted.

Impact of policy changes on the efficiency and returns-to-scale of Japanese financial institutions: an evaluation

This paper examines the impact of FSA's (Financial Services Agency) recent policy changes on the efficiency and returns-to-scale (RTS) of Japanese financial institutions including banks, securities companies and bank holding companies. Three kinds of efficiency are investigated namely, technical efficiency (TE), pure technical efficiency (PTE) and scale efficiency (SE) using the non-parametric methodology named data envelopment analysis (DEA). The DEA analysis shows a substantial improvement in the overall efficiency of Japanese banks, albeit a significant difference of efficiency scores between the major/city banks and the regional banks. Results are robust to alternative specifications of efficiency and scale changes.

Evaluation of the medium-term outcomes and impact of the Rowan Nicks Scholarship Programme

Rowan Nicks was a cardiothoracic surgeon in Sydney. He endowed the Rowan Nicks Scholarship Programme of the Royal Australasian College of Surgeons, which was initiated in 1991 to provide opportunities for clinicians from developing countries so that they return to their countries as leaders and teachers. This paper's objective was to evaluate the outcomes and impact of the scholarship on individuals and their communities.

An evaluation of the impact of using authentic design and build industry projects in project-based learning

BACKGROUNDChisholm’s ‘first year experience’ is a significant feature of the new industry focused Bachelor of Engineering Technology program delivered in association with the South East Melbourne Manufacturers’ Alliance (SEMMA). This conceive-design-implement-operate (CDIO Initiative) program commenced as a full time program in first semester 2012. Whereas it is common for CDIO Initiative programs to have a first year experience program containing a project typical of the type of industry project they would complete as a graduate engineer or engineering technologist, this goes further by using real industry projects provided by SEMMA members.This design-and-build industry project runs across both semesters supporting project-based learning in three first year subjects. A concern is that the industry involvement of the projects adds substantially to an already heavy student workload. This has been further increased by the addition of two additional first year initiatives: writing workshops, and training in, and substantial use of, student oral presentations. It is recognised that an excessive workload could lead students to adopt surface learning approaches in other subjects.PURPOSEThe goal of the project is to evaluate student perceptions of the value and work load impact of the industry project and the other new first year initiatives.DESIGN/METHODCentral to this project is a student survey-based evaluation of the industry project based learning that is the core of the ‘first year experience’. The participants were limited to the small group of students who, in a single year, completed all three subjects that comprise the ‘first year experience’. To avoid compromising the results the survey was administered by Chisholm Institute’s Department of Strategy and Planning with no engineering technology degree program staff present. The survey included questions to enable responses to be linked with specific student demographics without identifying any of the respondents.RESULTSThe study showed the industry project-based learning had worthwhile outcomes but placed considerable time pressures on most respondents. For some, this also impacted on their other subjects. A first year oral presentation program was also shown to have worthwhile outcomes. However no conclusions could be reliably drawn on the third initiative – writing workshops.CONCLUSIONSThe results confirm that the authentic industry project is considered a worthwhile initiative but contributes significantly to student overload. This applies also – to a lesser extent – to the first year oral presentation program. Both also require new approaches to delivery as student numbers increase. Strategies to address these issues are discussed.

The impact of increasing course enrolment on student evaluation of teaching in engineering education

Student evaluation of teaching (SET) is important, commonplace and may be used in staff performance management. The SET literature suggests that class size is a negative systematic influence on SET ratings. In this paper we investigate time-series SET data from a large first-year engineering class where a decline in SET ratings was observed over time as course enrolment increased. We observe a negative halo effect of increasing class size on mean SET ratings and conclude that increasing course enrolment leads to a significant reduction in all mean SET ratings, even when the course learning design remains essentially unchanged. We also find an additional differential effect of increasing course enrolment on mean SET ratings. We observe that the marginal reduction in mean SET ratings for each additional student in the course enrolment is greater for those aspects of the student learning experience that are likely to be most directly impacted by increasing class size. We provide implications for practice from these findings.

Evaluation of nurses' perceptions of the impact of targeted depression education and a screening and referral tool in an acute cardiac setting.

AIMS AND OBJECTIVES: The aim of this study was to evaluate nurses' perceptions of an education programme and screening and referral tool designed for cardiac nurses to facilitate depression screening and referral procedures for patients with coronary heart disease. BACKGROUND: There is a high prevalence of depression in patients with coronary heart disease that is often undetected. It is important therefore that nurses working with cardiac patients are equipped with the knowledge and skills to recognise the signs and symptoms of depression and refer appropriately. DESIGN: A qualitative approach with purposive sampling and semi-structural interviews was implemented within the Donabedian 'Structure-Process-Outcome' evaluation framework. METHODS: Semi-structured interviews were conducted with 14 cardiac nurses working in a major metropolitan hospital six weeks post-attending an education programme on depression and coronary heart disease. Thematic data analysis was implemented, specifically adhering to Halcomb and Davidson's (2006) pragmatic data analysis, to examine nurse knowledge and experience of depression assessment and referral in an acute cardiac ward. RESULTS: The key findings of this study were that the education programme: (1) increased the knowledge base of nurses working with cardiac patients on comorbid depression and coronary heart disease, and (2) assisted in the identification of depression and the referral of 'at risk' patients. CONCLUSIONS: Emphasis was placed on the translational significance of educating cardiac nurses about depression via the introduction of a depression screening and referral instrument designed specifically for use in the cardiac ward. As a result, participants found they were better equipped to identify depressive symptoms and, guided by the screening instrument, to confidently instigate referral procedures. RELEVANCE TO CLINICAL PRACTICE: Much complexity lies in caring for cardiac patients with depression, including issues such as misdiagnosis. Targeted education, including use of appropriate instruments, has the potential to facilitate early recognition of the signs and symptoms of depression in the acute cardiac setting.

Characterization and evaluation of the impact of feed management on the effluents of Nile tilapia (Oreochromis niloticus) culture

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Evaluation of the use of Syzygium cumini fruit extract as an antioxidant additive in orange juice and its sensorial impact

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)