The utility of a workplace injury instrument in prediction of workplace injury

Workplace injuries are common and destructive to persons, organisations, and society. Various instruments presently exist that are designed to assess the factors underlying workplace injury. The study reports on the construct and predictive validity of a 46-item instrument, the safety perception survey (SPS), currently used to assess safety climate in industrial organisations throughout Australia. Initially, factor analysis was conducted on the data from a sample of 1238 employees from nine organisations, which indicated a one-factor solution, was the best fit. A structural equation model (SEM) linking injury rates to the safety climate measure for 16 sub-groups of six industrial organisations indicated that the measure contributed just 23% of the variance in injury rates. Interestingly, the results indicated that the number of employees was a better and more significant predictor of injury (R² = 0.48). It is proposed that the SPS as is would need to be modified significantly from its current form to produce improvements in validity, as in its current form the survey is no more predictive of injury than organisational size. Future research into safety climate measures should incorporate predictive validity analysis on injury rates, as for many organisations; this is a performance outcome measure.

A simplified stroke rehabilitation assessment of movement instrument

Background and Purpose. An efficient, reliable, and valid instrument for assessing motor function in patients with stroke is needed by both clinicians and researchers. To improve administration efficiency, we applied the multidimensional Rasch model to the 30-item, 3-subscale Stroke Rehabilitation Assessment of Movement (STREAM) instrument to produce a concise, reliable, and valid instrument (simplified STREAM [S-STREAM]) for measuring motor function in patients with stroke. Subjects and Methods. The STREAM (consisting of 3 subscales: upper-limb movements, lower-limb movements, and mobility) was administered to 351 subjects with first stroke occurrence and a median time after stroke of 19.5 months. The unidimensionality of each subscale of the STREAM first was verified with unidimensional Rasch analysis. Each subscale of the STREAM then was simplified by deleting redundant items on the basis of expert opinion and the results of the Rasch analysis. The Rasch reliability of the S-STREAM and the concurrent validity of the S-STREAM with the STREAM were examined with multidimensional Rasch analysis and the intraclass correlation coefficient (ICC), respectively. Results. After deleting the items that did not fit the Rasch model, we found that the 8-item upper-limb movement subscale, the 9-item lower-limb movement subscale, and the 10-item mobility subscale assessed single, unidimensional upper-limb movements, lower-limb movements, and mobility, respectively. We selected 5 items from each subscale to construct the S-STREAM and found that the reliability of each subscale of the resulting simplified instrument was high (Rasch reliability coefficients of [greater than or equal to] .91). The agreement between the subscale scores (Rasch estimates) of the S-STREAM and those of the STREAM was excellent (ICC of [greater than or equal to] .99, with a lower limit for the 95% confidence interval of [greater than or equal to] .985), indicating good concurrent validity of the S-STREAM with the STREAM. Discussion and Conclusion. The S-STREAM demonstrates high Rasch reliability, unidimensionality, and concurrent validity with the STREAM in patients with stroke. Furthermore, the S-STREAM is efficient to administer, as it consists of only half the number of items in the original STREAM. Additional studies to examine other psychometric properties (eg, predictive validity and responsiveness) of the S-STREAM or its psychometric properties in various recovery stages after stroke are needed to further establish its utility in both clinical and research settings.

Development of an instrument for the analysis of problem gambling counselling practice

This article provides an overview of the development and validation of a Counsellor Task Analysis (Problem Gambling) [CTA (PG)] instrument undertaken in order to document the activities of counsellors in problem gambling services. The CTA (PG) aims to provide a broad overview of the complexity of the counsellor's role; specify the range of tasks they perform; and document the relationship between the frequency of task performance and the counsellor's beliefs about the importance of the tasks performed.

The CTA (PG) instrument addresses nine dimensions of practice activity through nine subscales, all of which demonstrate internal consistency. It appears to be a strong instrument in terms of its measurement error characteristics for recommending its use with counsellors engaged in the field of gambling. The CTA (PG) gives counsellors the opportunity to document their practice and theories in use when dealing with a problem gambler, a member of the problem gambler's family and the community at large. The psychometric findings reported in this article should be viewed as the preliminary results of an ongoing research effort and further psychometric testing is anticipated.

Early detection of emotional and behavioural problems in children with diabetes: the validity of the child health questionnaire as a screening instrument

Aims: To assess the validity of the Child Health Questionnaire (CHQ) as a screening tool for detecting 'at risk' emotional and behavioural  maladjustment in children with diabetes, using the Behaviour Assessment System for Children (BASC) as a gold standard measure. Methods: CHQ and BASC were administered to 103 parents of children with Type 1 diabetes, aged 7–12 years. Sub-scales of the two measures were compared using Pearson's bivariate correlations. CHQ sensitivity and specificity cut-points were optimized against the BASC borderline category using receiver operating characteristic curves. Results: The BASC Externalizing Problems scale correlated strongly with CHQ Behaviour, Global Behaviour, Mental Health, Family Activities and Family Cohesion scales (r-values −0.68, −0.54, −0.51, −0.59, and −0.42, respectively). BASC Internalizing Problems scale correlated strongly with CHQ Behaviour, Mental Health and Family Cohesion scales (r-values −0.40, −0.43 and −0.45, respectively). Using receiver operating characteristic curve analysis, the CHQ Mental Health scale most effectively identified children classified as borderline on the BASC Internalizing Problems scale (sensitivity 87%, specificity 78%), while the CHQ Global Behaviour scale most effectively identified children classified as borderline on the BASC Externalizing Problems scale (sensitivity 73%, specificity 82%). Conclusions: Significant correlations were seen between the CHQ Global Behaviour and Mental Health scales and the BASC Externalizing and Internalizing scales, respectively. Sequential use of the CHQ, as a screening tool, followed by an established mental health measure such as the BASC, may help identify children with diabetes 'at risk' for chronic maladjustment and poor health outcomes.

Validity of the assessment of quality of life (AQoL) utility instrument in patients with operable and inoperable lung cancer

There have been few longitudinal studies of quality of life in patients with all stages of lung cancer, particularly those that have included measures of utility. The purpose of this study was to examine the psychometric properties of the Assessment of Quality of Life instrument (AQoL) in patients with lung cancer. The AQoL is a health-related quality of life questionnaire and provides a descriptive system for a multi-attribute utility instrument (MAU), so that scores can be used in cost-utility evaluations. In the present study the reliability (internal consistency) of the AQoL was examined and the concurrent validity was assessed using the Medical Outcomes 36-item Short Form Health Survey (SF-36) as the comparator instrument. The sensitivity to different health states of the AQoL and the responsiveness to change over time was also examined. A prospective, non-experimental cohort study was undertaken. Ninety-two participants with all stages of lung cancer were recruited from a tertiary multi-disciplinary lung cancer clinic. Ninety participants had non-small cell lung cancer (NSCLC) and two had limited stage small cell lung cancer. The AQOL and SF-36 surveys were administered concurrently at baseline. In patients with NSCLC the surveys were then repeated 3 and 6 months later. Correlations between the baseline AQoL summary scales and SF-36 summary scales support the divergent and convergent validity of the AQoL. Reliability was also found to be sufficient (Cronbach's Alpha = 0.76). In addition, in patients with inoperable NSCLC, baseline AQoL scores were found to be predictive of survival at 6 months in Cox proportional hazards multivariate analysis. However, the physical components summary score of the SF-36 was more sensitive to differences in health states between patients with different stages of NSCLC at 6 months of follow-up and more responsive to change over time in both operable and inoperable patients with NSCLC than the AQoL. The findings support the construct validity and reliability of the AQoL in this population. However, there remains some uncertainty about whether the AQoL has sufficient sensitivity to different health states in this population. Further studies using other MAU instruments may determine whether alternative instruments are more sensitive to different health states in individuals with lung cancer.

The performance of solarscan : an automated dermoscopy image analysis instrument for the diagnosis of primary melanoma

Objective To describe the diagnostic performance of SolarScan (Polartechnics Ltd, Sydney, Australia), an automated instrument for the diagnosis of primary melanoma.

Design Images from a data set of 2430 lesions (382 were melanomas; median Breslow thickness, 0.36 mm) were divided into a training set and an independent test set at a ratio of approximately 2:1. A diagnostic algorithm (absolute diagnosis of melanoma vs benign lesion and estimated probability of melanoma) was developed and its performance described on the test set. High-quality clinical and dermoscopy images with a detailed patient history for 78 lesions (13 of which were melanomas) from the test set were given to various clinicians to compare their diagnostic accuracy with that of SolarScan.

Setting Seven specialist referral centers and 2 general practice skin cancer clinics from 3 continents. Comparison between clinician diagnosis and SolarScan diagnosis was by 3 dermoscopy experts, 4 dermatologists, 3 trainee dermatologists, and 3 general practitioners.

Patients Images of the melanocytic lesions were obtained from patients who required either excision or digital monitoring to exclude malignancy.

Main Outcome Measures Sensitivity, specificity, the area under the receiver operator characteristic curve, median probability for the diagnosis of melanoma, a direct comparison of SolarScan with diagnoses performed by humans, and interinstrument and intrainstrument reproducibility.

Results The melanocytic-only diagnostic model was highly reproducible in the test set and gave a sensitivity of 91% (95% confidence interval [CI], 86%-96%) and specificity of 68% (95% CI, 64%-72%) for melanoma. SolarScan had comparable or superior sensitivity and specificity (85% vs 65%) compared with those of experts (90% vs 59%), dermatologists (81% vs 60%), trainees (85% vs 36%; P =.06), and general practitioners (62% vs 63%). The intraclass correlation coefficient of intrainstrument repeatability was 0.86 (95% CI, 0.83-0.88), indicating an excellent repeatability. There was no significant interinstrument variation (P = .80).

Conclusions SolarScan is a robust diagnostic instrument for pigmented or partially pigmented melanocytic lesions of the skin. Preliminary data suggest that its performance is comparable or superior to that of a range of clinician groups. However, these findings should be confirmed in a formal clinical trial.

A usability instrument for evaluating websites-navigation elements

Many small businesses websites have become an important advertising medium. However little consideration is given to how these websites might be made more effective. Many factors impact on website effectiveness, including navigation. Research here describes a usability instrument developed for evaluating small business websites and uses navigation as an example of its application. The research found that the quality of navigation does have an impact on ease-of-use of a site, user's emotional response and frustration levels and a user's intention to return to that website. The research also established the statistically significant elements that contribute to navigation.

Does the type of derivative instrument used by companies impact firm value?

We explore the relationship between the type of derivative instrument used and firm value, in a sample of Australian firms. Specifically, we examine the impact of the corporate use of swaps, futures, forwards and options, and the extent of such usage, on firm value. Our findings suggest that a 'discount' is most severely imposed on users of swaps.

Evaluating quality of life in hip and knee replacement: psychometric properties of the World Health Organization Quality of Life short version instrument

Objective: To evaluate the psychometric properties of the World Health Organization Quality of Life short version instrument (WHOQOL-BREF), and to determine its responsiveness in assessing early outcome after total hip or knee replacement surgery.

Methods: At baseline (entry to an orthopedic waiting list), 279 participants completed the WHOQOL-BREF instrument, Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), Assessment of Quality of Life (AQOL) instrument, Kessler Psychological Distress (K10) scale, and the modified Health Assessment Questionnaire (MHAQ). A total of 74 patients completed reassessments 3 months after surgery.

Results: The WHOQOL-BREF demonstrated acceptable internal consistency for all domains (Cronbach's = 0.76-0.84) and moderate concurrent validity for the physical and psychological domains (r = 0.67 for physical versus AQOL; r = -0.71 for psychological versus K10). Minimal ceiling or floor effects were identified at baseline or 3 months, except for the social relationships domain. The disease-specific WOMAC subscales were most responsive to change (relative efficiency [RE] 0.66-1.00). Apart from social relationships, all WHOQOL-BREF scores improved significantly after surgery. The physical domain was more responsive than the AQOL (RE 0.50 versus 0.42) and was similar to the MHAQ (RE 0.55 for MHAQ). The responsiveness of the psychological domain was similar to that of the K10 scale (RE 0.11 versus 0.08).

Conclusion: The WHOQOL-BREF has good psychometric properties for use in persons with severe joint disease, and by providing complementary information, it offers clinicians and researchers an additional tool for comprehensively assessing quality of life in this patient group.

A new instrument for targeting falls prevention interventions was accurate and clinically applicable in a hospital setting

Background and Objective: To describe the diagnostic accuracy and practical application of the Peter James Centre Falls Risk Assessment Tool (PJC-FRAT), a multidisciplinary falls risk screening and intervention deployment instrument.

Methods: In phase 1, the accuracy of the PJC-FRAT was prospectively compared to a gold standard (the STRATIFY) on a cohort of subacute hospital patients (n = 122). In phase 2, the PJC-FRAT was temporally reassessed using a subsequent cohort (n = 316), with results compared to those of phase 1. Primary outcomes were falls (events), fallers (patients who fell), and hospital completion rates of the PJC-FRAT.

Results: In phase 1, PJC-FRAT accuracy of identifying fallers showed  sensitivity of 73% (bootstrap 95% confidence interval CI = 55, 90) and specificity of 75% (95% CI = 66, 83), compared with the STRATIFY (cutoff ≥ 2/5) sensitivity of 77% (95% CI = 59, 92) and specificity of 51% (95% CI = 41, 61). This difference was not significant. In phase 2, accuracy of nursing staff using the PJC-FRAT was lower. PJC-FRAT completion rates varied among disciplines over both phases: nurses and physiotherapists, ≥90%; occupational therapists, ≥82%; and medical officers, ≥57%.

Conclusion: The PJC-FRAT was practical and relatively accurate as a predictor of falls and a deployment instrument for falls prevention interventions, although continued staff education may be necessary to maintain its accuracy.

Parsimonious and efficient assessment of health-related quality of life in osteoarthritis research: validation of the Assessment of Quality of Life (AQoL) instrument

Background: The Assessment of Quality of Life (AQoL) utility instrument was psychometrically developed for the general population. This study aimed to explore its potential as an osteoarthritis (OA) outcome measure.

Methods: WOMAC, Lequesne index, SF-36, Visual analogue scales and the AQoL were administered to 222 people with OA. The ability of each questionnaire to detect differences between groups was based on (i) self-rated health (SRH) and, (ii) differences between people on an orthopedic waiting list (WL) vs people with OA in the community (C). Comparisons included effect size, relative efficiency and receiver operator characteristic curves.

Results: All instruments detected differences between groups; however no one instrument exhibited superior efficiency. The AQoL demonstrated strong psychometric properties.

Conclusion: The AQoL has equivalent performance to comparator questionnaires commonly used in OA research and would be a useful adjunct to well-established disease specific scales. The AQoL has important advantages; brevity (12 items), facilitates comparisons between disease groups, and delivers a utility score that can be used in health economic evaluations.

The validity and reliability of an instrument to assess children's outdoor play in various locations

The aim of this study was to develop and test the reliability and validity of survey items that examine the frequency with which primary school-aged children play in particular outdoor locations. Parents reported the number of days their child spent playing in specified outdoor locations (i.e., yard at home, own street/court/footpath, and park/playground) out-of-school hours on weekdays and weekend days during a typical week. To test the reliability of these items, the survey was administered on two occasions, 2 weeks apart, to a sample of 53 parents of children attending primary schools located in metropolitan Melbourne. The validity study involved the completion of a log book by 46 parents of primary school children over a 1-week period. Two weeks later, the same sample of parents completed the survey items. The test–retest reliability of individual items was determined using intra-class correlation coefficients (ICC). The kappa statistic and percent agreement between responses were used to assess validity by comparing the information provided in the log book with that provided in the survey. Results from the two studies suggest that the survey was generally a reliable and valid instrument for assessing the frequency with which children play in particular locations especially at home or in the street. Evidence of the reliability and validity of items assessing where children play is novel and important considering the need to promote children's physical activity in a variety of settings.

The validation of an Australian sign language instrument for outcome measurement of adults in mental health settings

Objective: There are currently no adult mental health outcome measures that have been translated into Australian sign language (Auslan). Without a valid and reliable Auslan outcome measure, empirical research into the efficacy of mental health interventions for sign language users is unattainable. To address this research problem the Outcome Rating Scale (ORS), a measure of general functioning, was translated into Auslan and recorded on to digital video disk for use in clinical settings. The purpose of the present study was therefore to examine the reliability, validity and acceptability of an Auslan version of the ORS (ORS-Auslan).
Method: The ORS-Auslan was administered to 44 deaf people who use Auslan as their first language and who identify as members of a deaf community (termed ‘Deaf’ people) on their first presentation to a mental health or counselling facility and to 55 Deaf people in the general community. The community sample also completed an Auslan version of the Depression Anxiety Stress Scale-21 (DASS-21).
Results: t-Tests indicated significant differences between the mean scores for the clinical and community sample. Internal consistency was acceptable given the low number of items in the ORS-Auslan. Construct validity was established by significant correlations between total scores on the DASS-21-Auslan and ORS-Auslan. Acceptability of ORS-Auslan was evident in the completion rate of 93% compared with 63% for DASS-21-Auslan.
Conclusions: This is the only Auslan outcome measure available that can be used across a wide variety of mental health and clinical settings. The ORS-Auslan provides mental health clinicians with a reliable and valid, brief measure of general functioning that can significantly distinguish between clinical and non-clinical presentations for members of the Deaf community.