A critical evaluation and comparison of two formative measures of system quality using criterion variables

Evaluating the validity of formative variables has presented ongoing challenges for researchers. In this paper we use global criterion measures to compare and critically evaluate two alternative formative measures of System Quality. One model is based on the ISO-9126 software quality standard, and the other is based on a leading information systems research model. We find that despite both models having a strong provenance, many of the items appear to be non-significant in our study. We examine the implications of this by evaluating the quality of the criterion variables we used, and the performance of PLS when evaluating formative models with a large number of items. We find that our respondents had difficulty distinguishing between global criterion variables measuring different aspects of overall System Quality. Also, because formative indicators “compete with one another” in PLS, it may be difficult to develop a set of measures which are all significant for a complex formative construct with a broad scope and a large number of items. Overall, we suggest that there is cautious evidence that both sets of measures are valid and largely equivalent, although questions still remain about the measures, the use of criterion variables, and the use of PLS for this type of model evaluation.

Evaluation of Trippple : a field analysis

This paper illustrates a field research performed with a team of experts involved in the evaluation of Trippple, a system aimed at supporting the different phases of a tourist trip, in order to provide feedback and insights, both on the functionalities already implemented (that at the time of evaluation were available only as early and very unstable prototypes), and on the functionalities still to be implemented. We show how the involvement of professionals helped to focus on challenging aspects, instead of less important, cosmetic, issues and resulted profitable in terms of early feedback, issues spotted, and improvements suggested

Review of statistical methods for disease mapping

Cancer poses an undeniable burden to the health and wellbeing of the Australian community. In a recent report commissioned by the Australian Institute for Health and Welfare(AIHW, 2010), one in every two Australians on average will be diagnosed with cancer by the age of 85, making cancer the second leading cause of death in 2007, preceded only by cardiovascular disease. Despite modest decreases in standardised combined cancer mortality over the past few decades, in part due to increased funding and access to screening programs, cancer remains a significant economic burden. In 2010, all cancers accounted for an estimated 19% of the country's total burden of disease, equating to approximately $3:8 billion in direct health system costs (Cancer Council Australia, 2011). Furthermore, there remains established socio-economic and other demographic inequalities in cancer incidence and survival, for example, by indigenous status and rurality. Therefore, in the interests of the nation's health and economic management, there is an immediate need to devise data-driven strategies to not only understand the socio-economic drivers of cancer but also facilitate the implementation of cost-effective resource allocation for cancer management...

Upper-body morbidity after breast cancer : incidence and evidence for evaluation, prevention, and management within a prospective surveillance model of care

The purpose of this paper is to review the incidence of upper-body morbidity (arm and breast symptoms, impairments, and lymphedema), methods for diagnosis, and prevention and treatment strategies. It was also the purpose to highlight the evidence base for integration of prospective surveillance for upper-body morbidity within standard clinical care of women with breast cancer. Between 10% and 64% of women report upper-body symptoms between 6 months and 3 years after breast cancer, and approximately 20% develop lymphedema. Symptoms remain common into longer-term survivorship, and although lymphedema may be transient for some, those who present with mild lymphedema are at increased risk of developing moderate to severe lymphedema. The etiology of morbidity seems to be multifactorial, with the most consistent risk factors being those associated with extent of treatment. However, known risk factors cannot reliably distinguish between those who will and will not develop upper-body morbidity. Upper-body morbidity may be treatable with physical therapy. There is also evidence in support of integrating regular surveillance for upper-body morbidity into the routine care provided to women with breast cancer, with early diagnosis potentially contributing to more effective management and prevention of progression of these conditions.

Spatial clusters of suicide in Australia

Background: Understanding the spatial distribution of suicide can inform the planning, implementation and evaluation of suicide prevention activity. This study explored spatial clusters of suicide in Australia, and investigated likely socio-demographic determinants of these clusters. Methods: National suicide and population data at a statistical local area (SLA) level were obtained from the Australian Bureau of Statistics for the period of 1999 to 2003. Standardised mortality ratios (SMR) were calculated at the SLA level, and Geographic Information System (GIS) techniques were applied to investigate the geographical distribution of suicides and detect clusters of high risk in Australia. Results: Male suicide incidence was relatively high in the northeast of Australia, and parts of the east coast, central and southeast inland, compared with the national average. Among the total male population and males aged 15 to 34, Mornington Shire had the whole or a part of primary high risk cluster for suicide, followed by the Bathurst-Melville area, one of the secondary clusters in the north coastal area of the Northern Territory. Other secondary clusters changed with the selection of cluster radius and age group. For males aged 35 to 54 years, only one cluster in the east of the country was identified. There was only one significant female suicide cluster near Melbourne while other SLAs had very few female suicide cases and were not identified as clusters. Male suicide clusters had a higher proportion of Indigenous population and lower median socio-economic index for area (SEIFA) than the national average, but their shapes changed with selection of maximum cluster radii setting. Conclusion: This study found high suicide risk clusters at the SLA level in Australia, which appeared to be associated with lower median socio-economic status and higher proportion of Indigenous population. Future suicide prevention programs should focus on these high risk areas.

A known-groups evaluation of the Response Bias Scale in a neuropsychological setting

We evaluated the Minnesota Multiphasic Personality Inventory-Second Edition (MMPI-2) Response Bias Scale (RBS). Archival data from 83 individuals who were referred for neuropsychological assessment with no formal diagnosis (n = 10), following a known or suspected traumatic brain injury (n = 36), with a psychiatric diagnosis (n = 20), or with a history of both trauma and a psychiatric condition (n = 17) were retrieved. The criteria for malingered neurocognitive dysfunction (MNCD) were applied, and two groups of participants were formed: poor effort (n = 15) and genuine responders (n = 68). Consistent with previous studies, the difference in scores between groups was greatest for the RBS (d = 2.44), followed by two established MMPI-2 validity scales, F (d = 0.25) and K (d = 0.23), and strong significant correlations were found between RBS and F (rs = .48) and RBS and K (r = −.41). When MNCD group membership was predicted using logistic regression, the RBS failed to add incrementally to F. In a separate regression to predict group membership, K added significantly to the RBS. Receiver-operating curve analysis revealed a nonsignificant area under the curve statistic, and at the ideal cutoff in this sample of >12, specificity was moderate (.79), sensitivity was low (.47), and positive and negative predictive power values at a 13% base rate were .25 and .91, respectively. Although the results of this study require replication because of a number of limitations, this study has made an important first attempt to report RBS classification accuracy statistics for predicting poor effort at a range of base rates.

Application of clustering technique to generating capacity state model for reliability evaluation

Capacity probability models of generating units are commonly used in many power system reliability studies, at hierarchical level one (HLI). Analytical modelling of a generating system with many units or generating units with many derated states in a system, can result in an extensive number of states in the capacity model. Limitations on available memory and computational time of present computer facilities can pose difficulties for assessment of such systems in many studies. A cluster procedure using the nearest centroid sorting method was used for IEEE-RTS load model. The application proved to be very effective in producing a highly similar model with substantially fewer states. This paper presents an extended application of the clustering method to include capacity probability representation. A series of sensitivity studies are illustrated using IEEE-RTS generating system and load models. The loss of load and energy expectations (LOLE, LOEE), are used as indicators to evaluate the application

An assessment for cost effective maintenance and operation of the Callide Power Station electrical system, using reliability evaluation

The reliable operation of the electrical system at Callide Power Station is of extreme importance to the normal everyday running of the Station. This study applied the principles of reliability to do an analysis on the electrical system at Callide Power Station. It was found that the level of expected outage cost increased exponentially with a declining level of maintenance. Concluding that even in a harsh economic electricity market where CS Energy tries and push their plants to the limit, maintenance must not be neglected. A number of system configurations were found to increase the reliability of the system and reduce the expected outage costs. A number of other advantages were identified as a result of using reliability principles to do this study on the Callide electrical system configuration.

Evaluation of Eph receptor and ephrin expression within the human cornea and limbus

Eph receptor tyrosine kinases and their ligands, the ephrins, regulate the development and maintenance of multiple organs but little is known about their potential role within the cornea. The purpose of this study was to perform a thorough investigation of Eph/ephrin expression within the human cornea including the limbal stem cell niche. Initially, immunohistochemistry was performed on human donor eyes to determine the spatial distribution of Eph receptors and ephrins in the cornea and limbus. Patterns of Eph/ephrin gene expression in (1) immortalised human corneal endothelial (B4G12) or corneal epithelial (HCE-T) cell lines, and (2) primary cultures of epithelial or stromal cells established from the corneal limbus of cadaveric eye tissue were then assessed by reverse transcription (RT) PCR. Limbal epithelial or stromal cells from primary cultures were also assessed for evidence of Eph/ephrin-reactivity by immunofluorescence. Immunoreactivity for ephrinA1 and EphB4 was detected in the corneal endothelium of donor eyes. EphB4 was also consistently detected in the limbal and corneal epithelium and in cells located in the stroma of the peripheral cornea. Expression of multiple Eph/ephrin genes was detected in immortalised corneal epithelial and endothelial cell lines. Evidence of Eph/ephrin gene expression was also demonstrated in primary cultures of human limbal stromal (EphB4, B6; ephrinA5) and epithelial cells (EphA1, A2; ephrinA5, B2) using both RT-PCR and immunofluorescence. The expression of Eph receptors and ephrins within the human cornea and limbus is much wider than previously appreciated and suggests multiple potential roles for these molecules in the maintenance of normal corneal architecture.

Tracking new directions in the evaluation of postgraduate supervision

This article focuses on the evaluation of thesis supervision and highlights the vast range of problem areas presently documented as significant areas of concern for both graduate students and their supervisors. Additionally, the authors report on a study completed in 1995, which surveyed all Australian universities about current evaluative practices in postgraduate supervision. The conclusion of this study was that the conduct of such evaluations appears to be minimal and is primarily designed to obtain an indicator of the general “health” of a university's postgraduate supervision rather than to foster improved supervisory practices. As part of the same study, the authors conducted University faculty-based student and supervisor focus groups. Key issues emerging from these focus groups were: (1) the importance of relational aspects of supervision as the student communicates over the long term with one or more supervisors; (2) the importance of systematic feedback, monitoring, and evaluation to the supervisory process; and (3) the lack of strategies to facilitate this evaluative feedback process. On the basis of these findings, the authors designed evaluative strategies to facilitate regular ongoing feedback between students and supervisors.

Evaluation of the "reconceptualising early mathematics learning" project

The Pattern and Structure Mathematics Awareness Project (PASMAP) has investigated the development of patterning and early algebraic reasoning among 4 to 8 year olds over a series of related studies. We assert that an awareness of mathematical pattern and structure enables mathematical thinking and simple forms of generalisation from an early age. The project aims to promote a strong foundation for mathematical development by focusing on critical, underlying features of mathematics learning. This paper provides an overview of key aspects of the assessment and intervention, and analyses of the impact of PASMAP on students’ representation, abstraction and generalisation of mathematical ideas. A purposive sample of four large primary schools, two in Sydney and two in Brisbane, representing 316 students from diverse socio-economic and cultural contexts, participated in the evaluation throughout the 2009 school year and a follow-up assessment in 2010. Two different mathematics programs were implemented: in each school, two Kindergarten teachers implemented the PASMAP and another two implemented their regular program. The study shows that both groups of students made substantial gains on the ‘I Can Do Maths’ assessment and a Pattern and Structure Assessment (PASA) interview, but highly significant differences were found on the latter with PASMAP students outperforming the regular group on PASA scores. Qualitative analysis of students’ responses for structural development showed increased levels for the PASMAP students; those categorised as low ability developed improved structural responses over a relatively short period of time.

A safe system-based approach to selection of clear zones, safety barriers and other roadside treatments

On average, 560 fatal run-off-road crashes occur annually in Australia and 135 in New Zealand. In addition, there are more than 14,000 run-off-road crashes causing injuries each year across both countries. In rural areas, run-off-road casualty crashes constitute 50-60% of all casualty crashes. Their severity is particularly high with more than half of those involved sustaining fatal or serious injuries. This paper reviews the existing approach to roadside hazard risk assessment, selection of clear zones and hazard treatments. It proposes a modified approach to roadside safety evaluation and management. It is a methodology based on statistical modelling of run-off-road casualty crashes, and application of locally developed crash modification factors and severity indices. Clear zones, safety barriers and other roadside design/treatment options are evaluated with a view to minimise fatal and serious injuries – the key Safe System objective. The paper concludes with a practical demonstration of the proposed approach. The paper is based on findings from a four-year Austroads research project into improving roadside safety in the Safe System context.

On the statistical determination of optimal camera configurations in large scale surveillance networks

The selection of optimal camera configurations (camera locations, orientations etc.) for multi-camera networks remains an unsolved problem. Previous approaches largely focus on proposing various objective functions to achieve different tasks. Most of them, however, do not generalize well to large scale networks. To tackle this, we introduce a statistical formulation of the optimal selection of camera configurations as well as propose a Trans-Dimensional Simulated Annealing (TDSA) algorithm to effectively solve the problem. We compare our approach with a state-of-the-art method based on Binary Integer Programming (BIP) and show that our approach offers similar performance on small scale problems. However, we also demonstrate the capability of our approach in dealing with large scale problems and show that our approach produces better results than 2 alternative heuristics designed to deal with the scalability issue of BIP.