Reframe QUT's evaluation framework : a case study of planning, policy and positioning leading to educational best practice

Every university in Australia has a set of policies that guide the institution in its educational practices, however, the policies are often developed in isolation to each other. Now imagine a space where policies are evidence-based, refined annually, cohesively interrelated, and meet stakeholders’ needs. Is this happenstance or the result of good planning? Culturally, Queensland University of Technology (QUT) is a risk-averse institution that takes pride in its financial solvency and is always keen to know “how are we going?” With a twenty-year history of annual reporting that assures the quality of course performance through multiple lines of evidence, QUT’s Learning and Teaching Unit went one step further and strategically aligned a suite of policies that take into consideration the needs of their stakeholders, collaborate with other areas across the institution and use multiple lines of evidence to inform curriculum decision-making. In QUT’s experience, strategic planning can lead to policy that is designed to meet stakeholders’ needs, not manage them; where decision-making is supported by evidence, not rhetoric; where all feedback is incorporated, not ignored; and where policies are cohesively interrelated, not isolated. While many may call this ‘policy nirvana’, QUT has positioned itself to demonstrate good educational practice through Reframe, its evaluation framework. In this case, best practice was achieved through the application of a theory of change and a design-led logic model that allows for transition to other institutions with different cultural specificity. The evaluation approach follows Seldin’s (2003) notion to offer depth and breadth to the evaluation framework along with Berk’s (2005) concept of multiple lines of evidence. In summary, this paper offers university executives, academics, planning and quality staff an opportunity to understand the critical steps that lead to strategic planning and design of evidence-based educational policy that positions a university for best practice in learning and teaching.

Course evidence matrix : a collaborative evaluation using multiple lines of evidence

Welcome to the Evaluation of course matrix. This matrix is designed for highly qualified discipline experts to evaluate their course, major or unit in a systemic manner. The primary purpose of the Evaluation of course matrix is to provide a tool that a group of academic staff at universities can collaboratively review the assessment within a course, major or unit annually. The annual review will result in you being ready for an external curricula review at any point in time. This tool is designed for use in a workshop format with one, two or more academic staff, and will lead to an action plan for implementation. I hope you find this tool useful in your assessment review.

Facilitating lifestyle changes to manage menopausal symptoms in women with breast cancer: A randomized controlled pilot trial of The Pink Women’s Wellness Program

OBJECTIVE Women diagnosed as having breast cancer may experience difficulties with posttreatment effects such as menopausal symptoms. The aims of this pilot study were to (1) evaluate the impact of a multimodal lifestyle program on reducing menopausal symptoms in women with breast cancer and (2) examine the impact of the program on health-related quality of life (HRQoL) and adherence to lifestyle recommendations. METHODS Overall, 55 women aged 45 to 60 years with one moderate to severe menopausal symptom and a history of breast cancer were randomized into an intervention group (n = 26) or a control group (n = 29). Women in the intervention group received a lifestyle intervention (The Pink Women’s Wellness Program) that included clinical consultations and a tailored health education program. Measurements of menopausal symptoms (Greene Climacteric Scale), HRQoL (SF-12 and Functional Assessment of Cancer Therapy—Breast), and modifiable lifestyle factors (food intake, physical activity, smoking and alcohol use, and sleep disturbance) were taken at baseline and 12 weeks. RESULTS Women in the intervention group reported clinically significant reductions in many menopausal symptoms, specifically somatic symptoms (d = 0.52), vasomotor symptoms (d = 0.55), sexual dysfunction (d = .65), and overall menopausal symptoms (d = 0.54), at 12 weeks compared with the control group (d = 0.03, d = 0.24, d = 0.18, and d = 0.05, respectively). Women in the intervention group reported improvements in Functional Assessment of Cancer Therapy—Breast subscale scores, physical well-being and functional well-being, and Functional Assessment of Cancer Therapy—General total scores (intervention group: d = 0.54, d = 0.50, and d = 0.48, respectively; control group: d = 0.22, d = 0.11, and d = 0.05, respectively). CONCLUSIONS The Pink Women’s Wellness Program is effective in decreasing menopausal symptoms, thus improving HRQoL. This being a pilot study, further research is recommended to investigate the benefits of combining nonpharmacological interventions for women with breast cancer to reduce their treatment-related menopausal symptoms.

Examination of the properties of IMRT and VMAT beams and evaluation against pre-treatment quality assurance results

This study aimed to provide a detailed evaluation and comparison of a range of modulated beam evaluation metrics, in terms of their correlation with QA testing results and their variation between treatment sites, for a large number of treatments. Ten metrics including the modulation index (MI), fluence map complexity (FMC), modulation complexity score (MCS), mean aperture displacement (MAD) and small aperture score (SAS) were evaluated for 546 beams from 122 IMRT and VMAT treatment plans targeting the anus, rectum, endometrium, brain, head and neck and prostate. The calculated sets of metrics were evaluated in terms of their relationships to each other and their correlation with the results of electronic portal imaging based quality assurance (QA) evaluations of the treatment beams. Evaluation of the MI, MAD and SAS suggested that beams used in treatments of the anus, rectum, head and neck were more complex than the prostate and brain treatment beams. Seven of the ten beam complexity metrics were found to be strongly correlated with the results from QA testing of the IMRT beams (p < 0.00008). For example, Values of SAS (with MLC apertures narrower than 10 mm defined as “small”) less than 0.2 also identified QA passing IMRT beams with 100% specificity. However, few of the metrics are correlated with the results from QA testing of the VMAT beams, whether they were evaluated as whole 360◦ arcs or as 60◦ sub-arcs. Select evaluation of beam complexity metrics (at least MI, MCS and SAS) is therefore recommended, as an intermediate step in the IMRT QA chain. Such evaluation may also be useful as a means of periodically reviewing VMAT planning or optimiser performance.

A stakeholder process evaluation of a social marketing walking intervention targeting children

One quarter of Australian children are overweight or obese (ABS, 2010), putting them at increased risk of physical and psychological health problems (Reilly et al., 2003). Overweight and obesity in childhood tends to persist into adulthood and is associated with premature death and morbidity (Reilly & Kelly, 2011). Increases in Australian children’s weight have coincided with declines in active transportation, such as walking, to school (Salmon et al., 2005). To address this problem, the Victorian Health Promotion Foundation (VicHealth), which is an independent statutory authority which advises government and contributes to promoting good health in Victoria (VicHealth, 2014), developed the Walk to School program. Walk to School aims to encourage primary school children in Victoria to walk to and from school more often. Walking to school is a low cost and effective means of reducing excess weight (Rosenberg et al., 2006) that can be easily integrated into daily routine (Brophy et al., 2011). The purpose of this paper is to present the results of the stakeholder process evaluation of Walk to School 2013, which forms part of a broader outcome evaluation that is currently in field. Although there is an emphasis on outcome evaluation of programs, process evaluation can be equally important in determining program success (Saunders et al., 2005). Further, process evaluation to assess program delivery and utilization is explicitly recommended by two social marketing frameworks (see Lefebvre et al., 1988; Walsh et al., 1993).

Illuminative evaluation as a method applied to Australian Government policy borrowing and implementation in higher education

Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.Any government deciding to invoke widespread change in its higher education sector through implementation of new policies impacts on every institution and all staff and students, often in both the time taken up and the heightened emotions caused. The central phenomenon that this study addresses is the process and consequences of policy changes in higher education in Australia. The aim of this article is to record the research design through the perspective (evaluation research), theoretical framework (program evaluation) and methods (content analysis, descriptive statistical analysis and bibliometric analysis) applied to the investigation of the 2003 federal government higher education reform package. This approach allows both the intended and unintended consequences arising from the policy implementation of three national initiatives focused on learning and teaching in higher education in Australia to surface. As a result, this program evaluation, also known in some disciplines as policy implementation analysis, will demonstrate the applicability of illuminative evaluation as a methodology and reinforce how program evaluation will assist and advise future government reform and policy implementation, and will serve as a legacy for future evaluative research.

Evaluating a web-based self-management intervention in patients with heart failure: A pilot study

This pilot study aimed to evaluate the feasibility of a web-based self-management intervention in patients with heart failure. The study consisted of two phases including developing the web-based application and examining its feasibility in a group of heart failure patients. The results of this study were consistent with the current literature which has failed to show the benefits of web-based interventions for chronic disease self-management. In the current thesis, therefore, issues influencing the effectiveness of the web-based interventions were analysed. Recommendations for improving effectiveness of the web-based applications were also provided.

A model-framed evaluation of elephant effects on tree and fire dynamics in African savannas

There is a concern that high densities of elephants in southern Africa could lead to the overall reduction of other forms of biodiversity. We present a grid-based model of elephant-savanna dynamics, which differs from previous elephant-vegetation models by accounting for woody plant demographics, tree-grass interactions, stochastic environmental variables (fire and rainfall), and spatial contagion of fire and tree recruitment. The model projects changes in height structure and spatial pattern of trees over periods of centuries. The vegetation component of the model produces long-term tree-grass coexistence, and the emergent fire frequencies match those reported for southern African savannas. Including elephants in the savanna model had the expected effect of reducing woody plant cover, mainly via increased adult tree mortality, although at an elephant density of 1.0 elephant/km2, woody plants still persisted for over a century. We tested three different scenarios in addition to our default assumptions. (1) Reducing mortality of adult trees after elephant use, mimicking a more browsing-tolerant tree species, mitigated the detrimental effect of elephants on the woody population. (2) Coupling germination success (increased seedling recruitment) to elephant browsing further increased tree persistence, and (3) a faster growing woody component allowed some woody plant persistence for at least a century at a density of 3 elephants/km2. Quantitative models of the kind presented here provide a valuable tool for exploring the consequences of management decisions involving the manipulation of elephant population densities. © 2005 by the Ecological Society of America.

Evaluation of intra- and extra-epithelial secretory IgA in chlamydial infections

IgA is an important mucosal antibody that can neutralize mucosal pathogens by either preventing attachment to epithelia (immune exclusion) or alternatively inhibit intraepithelial replication following transcytosis by the polymeric immunoglobulin receptor (pIgR). Chlamydia trachomatis is a major human pathogen that initially targets the endocervical or urethral epithelium in women and men, respectively. As both tissues contain abundant SIgA we assessed the protection afforded by IgA targeting different chlamydial antigens expressed during the extra and intraepithelial stages of infection. We developed an in vitro model utilizing polarizing cells expressing the murine pIgR together with antigen-specific mouse IgA, and an in vivo model utilizing pIgR-/- mice. SIgA targeting the extraepithelial chlamydial antigen, the major outer membrane protein (MOMP), significantly reduced infection in vitro by 24 % and in vivo by 44 %. Conversely, pIgR-mediated delivery of IgA targeting the intraepithelial inclusion membrane protein A (IncA) bound to the inclusion but did not reduce infection in vitro or in vivo. Similarly, intraepithelial IgA targeting the secreted protease Chlamydia protease-like activity factor (CPAF) also failed to reduce infection. Together, these data suggest the importance of pIgR-mediated delivery of IgA targeting extra but not intraepithelial chlamydial antigens for protection against a genital tract infection.

Catalytic activity evaluation of industrial Pd/C catalyst via gray-box dynamic modeling and simulation of hydropurification reactor

In this paper, dynamic modeling and simulation of the hydropurification reactor in a purified terephthalic acid production plant has been investigated by gray-box technique to evaluate the catalytic activity of palladium supported on carbon (0.5 wt.% Pd/C) catalyst. The reaction kinetics and catalyst deactivation trend have been modeled by employing artificial neural network (ANN). The network output has been incorporated with the reactor first principle model (FPM). The simulation results reveal that the gray-box model (FPM and ANN) is about 32 percent more accurate than FPM. The model demonstrates that the catalyst is deactivated after eleven months. Moreover, the catalyst lifetime decreases about two and half months in case of 7 percent increase of reactor feed flowrate. It is predicted that 10 percent enhancement of hydrogen flowrate promotes catalyst lifetime at the amount of one month. Additionally, the enhancement of 4-carboxybenzaldehyde concentration in the reactor feed improves CO and benzoic acid synthesis. CO is a poison to the catalyst, and benzoic acid might affect the product quality. The model can be applied into actual working plants to analyze the Pd/C catalyst efficient functioning and the catalytic reactor performance.

Performance evaluation of cloud-based parallel computing

As computational models in fields such as medicine and engineering get more refined, resource requirements are increased. In a first instance, these needs have been satisfied using parallel computing and HPC clusters. However, such systems are often costly and lack flexibility. HPC users are therefore tempted to move to elastic HPC using cloud services. One difficulty in making this transition is that HPC and cloud systems are different, and performance may vary. The purpose of this study is to evaluate cloud services as a means to minimise both cost and computation time for large-scale simulations, and to identify which system properties have the most significant impact on performance. Our simulation results show that, while the performance of Virtual CPU (VCPU) is satisfactory, network throughput may lead to difficulties.

Evaluation framework to assess benefits and harms of bone-anchored prosthesis

Bone-anchored prostheses are increasingly acknowledged as viable alternative method of attachment of artificial limb compared to socket-suspended prostheses. To date, a few osseointegration fixations are commercially available. Several devices are at different stages of development particularly in Europe and the US. Clearly, the current momentum experienced worldwide is creating a need for a standardized evaluation framework to assess the benefits and safety of each procedure.

Evaluation of the performance of a dengue outbreak detection tool for China

An outbreak detection and response system, using time series moving percentile method based on historical data, in China has been used for identifying dengue fever outbreaks since 2008. For dengue fever outbreaks reported from 2009 to 2012, this system achieved a sensitivity of 100%, a specificity of 99.8% and a median time to detection of 3 days, which indicated that the system was a useful decision tool for dengue fever control and risk-management programs in China.

The role of affect in consumer evaluation of health care services

Health care services are typically consumed out of necessity, typically to recover from illness. While the consumption of health care services can be emotional given that consumers experience fear, hope, relief, and joy, surprisingly, there is little research on the role of consumer affect in health care consumption. We propose that consumer affect is a heuristic cue that drives evaluation of health care services. Drawing from cognitive appraisal theory and affect-as-information theory, this article tests a research model (N = 492) that investigates consumer affect resulting from service performance on subsequent service outcomes.

Hearing parties' voices in Coordinated Family Dispute Resolution (CFDR) : An Australian pilot of a family mediation model designed for matters involving a history of domestic violence

This paper discusses the Coordinated Family Dispute Resolution (family mediation) process piloted in Australia in 2010–2012. This process was evaluated by the Australian Institute of Family Studies as being ‘at the cutting edge of family law practice’ because it involves the conscious application of mediation where there has been a history of family violence, in a clinically collaborative multidisciplinary and multi-agency setting. The Australian government’s failure to invest resources in the ongoing funding of this model jeopardises the safety and efficacy of family dispute resolution practice in family violence contexts, and compromises the hearing of the voices of family violence victims and their children.