A critical evaluation and comparison of two formative measures of system quality using criterion variables

Evaluating the validity of formative variables has presented ongoing challenges for researchers. In this paper we use global criterion measures to compare and critically evaluate two alternative formative measures of System Quality. One model is based on the ISO-9126 software quality standard, and the other is based on a leading information systems research model. We find that despite both models having a strong provenance, many of the items appear to be non-significant in our study. We examine the implications of this by evaluating the quality of the criterion variables we used, and the performance of PLS when evaluating formative models with a large number of items. We find that our respondents had difficulty distinguishing between global criterion variables measuring different aspects of overall System Quality. Also, because formative indicators “compete with one another” in PLS, it may be difficult to develop a set of measures which are all significant for a complex formative construct with a broad scope and a large number of items. Overall, we suggest that there is cautious evidence that both sets of measures are valid and largely equivalent, although questions still remain about the measures, the use of criterion variables, and the use of PLS for this type of model evaluation.

Revisiting associations between student performance outcomes and formative assessment opportunities: is there any impact on student learning?

This project developed as a result of some inconclusive data from an investigation of whether a relationship existed between the use of formative assessment opportunities and performance, as measured by final grade. We were expecting to show our colleagues and students that use of formative assessment resources had the potential to improve performance. This first study, done in semester 1 2002, indicated that there was no apparent relationship even though the students reported how useful they found the resources. This led us to ask if there was a transition effect
such that students were not yet working in an independent way and making full use of the resources, and/or whether in order to see an effect we needed to persuade non-users of the resources to become users before investigating if use can be correlated with improvement in performance. With the 2002-3 NextEd ASCILITE Research Grant we set out to repeat our project and to look at use and usefulness of resources in both first and second semester, to encourage non-users to become users and to investigate use with performance. Now our story has a different ending.

Considering if there is a need to measure the social impact of charities?

This paper proposes that a multidimensional measure of charities’ social impact should be developed. This would allow donors to evaluate the potential social benefit of giving to one cause or another. While such a multidimensional approach would be complicated, it could build on the literature suggesting that firms be measured using triple bottom line accounting and those used to evaluate firms for inclusion for ethical investing.

What is the "true" prevalence of female sexual dysfunctions and does the way we assess these conditions have an impact?

Introduction. A wide range of prevalence estimates of female sexual dysfunctions (FSD) have been reported.
Aim. Compare instruments used to assess FSD to determine if differences between instruments contribute to variation in reported prevalence.
Main Outcome Measures. Sexual Function Questionnaire combined with Female Sexual Distress Scale (SFQ-FSDS) was our gold standard, validated instrument for assessing FSD. Alternatives were SFQ alone and two sets of simple questions adapted from Laumann et al. 1994.
Methods. A postal survey was administered to a random sample of 356 Australian women aged 20 to 70 years.
Results. When assessed by SFQ-FSDS, prevalence estimates (95% confidence intervals) of hypoactive sexual desire disorder, sexual arousal disorder (lubrication), orgasmic disorder, and dyspareunia were 16% (12% to 20%), 7% (5% to 11%), 8% (6% to 12%), and 1% (0.5% to 3%), respectively. Prevalence estimates varied across alternative instruments for these disorders: 32% to 58%, 16% to 32%, 16% to 33%, and 3% to 23%, respectively. Compared with SFQ-FSDS alternative instruments produced higher estimates of desire, arousal and orgasm disorders and displayed a range of sensitivities (0.25 to 1.0), specificities (0.48 to 0.99), positive predictive values (0.01 to 0.56), and negative predictive values (0.95 to 1.0) across the disorders investigated. Kappa statistics comparing SFQ-FSDS and alternative instruments ranged from 0 to 0.71 but were predominantly 0.44 or less. Changing recall from previous month to 1 month or more in the previous year produced higher estimates for all disorders investigated. Including sexual distress produced lower estimates for desire, arousal, and orgasm disorders.
Conclusions. Prevalence estimates of FSD varied substantially across instruments. Relatively low positive predictive values and kappa statistics combined with a broad range of sensitivities and specificities indicated that different instruments identified different subgroups. Consequently, the instruments researchers choose when assessing FSD may affect prevalence estimates and risk factors they report.

What is the optimal level of population alcohol consumption for chronic disease prevention in England? Modelling the impact of changes in average consumption levels

Objective To estimate the impact of achieving alternative average population alcohol consumption levels on chronic disease mortality in England.

Design A macro-simulation model was built to simultaneously estimate the number of deaths from coronary heart disease, stroke, hypertensive disease, diabetes, liver cirrhosis, epilepsy and five cancers that would be averted or delayed annually as a result of changes in alcohol consumption among English adults. Counterfactual scenarios assessed the impact on alcohol-related mortalities of changing (1) the median alcohol consumption of drinkers and (2) the percentage of non-drinkers.

Data sources Risk relationships were drawn from published meta-analyses. Age- and sex-specific distributions of alcohol consumption (grams per day) for the English population in 2006 were drawn from the General Household Survey 2006, and age-, sex- and cause-specific mortality data for 2006 were provided by the Office for National Statistics.

Results The optimum median consumption level for drinkers in the model was 5 g/day (about half a unit), which would avert or delay 4579 (2544 to 6590) deaths per year. Approximately equal numbers of deaths from cancers and liver disease would be delayed or averted (∼2800 for each), while there was a small increase in cardiovascular mortality. The model showed no benefit in terms of reduced mortality when the proportion of non-drinkers in the population was increased.

Conclusions Current government recommendations for alcohol consumption are well above the level likely to minimise chronic disease. Public health targets should aim for a reduction in population alcohol consumption in order to reduce chronic disease mortality.

Changes and challenges in higher education : what is the impact on fieldwork education?

Although fieldwork practicums have long been mandatory and integral requirements of our professional education, there is now an increasing focus on integrating work experience more broadly into a range of academic programs. These activities are increasingly coming under the spotlight of universities and the Federal government (Patrick et al., 2008). The provision of quality fieldwork education for both occupational therapy students and fieldwork educators remains critical, requiring strong collaboration and partnerships between universities, the profession and representative bodies. However, we argue that as the characteristics of universities and students has changed considerably in recent years, the planning and implementation of fieldwork needs to be informed by an understanding of these ongoing changes.

Recruitment into diabetes prevention programs : what is the impact of errors in self-reported measures of obesity?

Background
Error in self-reported measures of obesity has been frequently described, but the effect of self-reported error on recruitment into diabetes prevention programs is not well established. The aim of this study was to examine the effect of using self-reported obesity data from the Finnish diabetes risk score (FINDRISC) on recruitment into the Greater Green Triangle Diabetes Prevention Project (GGT DPP).

Methods
The GGT DPP was a structured group-based lifestyle modification program delivered in primary health care settings in South-Eastern Australia. Between 2004–05, 850 FINDRISC forms were collected during recruitment for the GGT DPP. Eligible individuals, at moderate to high risk of developing diabetes, were invited to undertake baseline tests, including anthropometric measurements performed by specially trained nurses. In addition to errors in calculating total risk scores, accuracy of self-reported data (height, weight, waist circumference (WC) and Body Mass Index (BMI)) from FINDRISCs was compared with baseline data, with impact on participation eligibility presented.

Results
Overall, calculation errors impacted on eligibility in 18 cases (2.1%). Of n = 279 GGT DPP participants with measured data, errors (total score calculation, BMI or WC) in self-report were found in n = 90 (32.3%). These errors were equally likely to result in under- or over-reported risk. Under-reporting was more common in those reporting lower risk scores (Spearman-rho = −0.226, p-value < 0.001). However, underestimation resulted in only 6% of individuals at high risk of diabetes being incorrectly categorised as moderate or low risk of diabetes.

Conclusions
Overall FINDRISC was found to be an effective tool to screen and recruit participants at moderate to high risk of diabetes, accurately categorising levels of overweight and obesity using self-report data. The results could be generalisable to other diabetes prevention programs using screening tools which include self-reported levels of obesity.

Breaking up is hard to do : the economic impact of provisional funding contingent upon evidence development

Funding contingent upon evidence development (FED) has recently been the subject of some considerable debate in the literature but relatively little has been made of its economic impact. We argue that FED has the potential to shorten the lag between innovation and access but may also (i) crowd-out more valuable interventions in situations in which there is a fixed dedicated budget; or (ii) lead to a de facto increase in the funding threshold and increased expenditure growth in situations in which the programme budget is open-ended. Although FED would typically entail periodic review of provisional or interim listings, it may prove difficult to withdraw funding even at cost/QALY ratios well in excess of current listing thresholds. Further consideration of the design and implementation of FED processes is therefore required to ensure that its introduction yields net benefits over existing processes.

Domains of faith impact: how “faith” is perceived to shape faith-based international development organisations

Increasing interest in faith-based international development organisations (FBOs) recently has improved understanding of these agencies. One reason for complex, often contradictory findings is the lack of frameworks analysing the interactions of worldviews on organisational structures, processes, and behaviours of agencies, and development outcomes. We utilise Lincoln's (2003. Holy Terrors: Thinking about Religion after September 11. Chicago: University of Chicago Press) four “domains of religion” to explore how the literature reports faith impacting the shape of development FBOs’ structures, behaviours, and outcomes. Literature suggests faith has a significant impact upon these agencies. We outline very specific similarities and differences, highlighting the importance of nuanced analysis of faith's role in FBOs. Further research is needed to build more evidence around these impacts of faith on FBOs