Psychometric evaluation of the body change inventory: an assessment instrument for adolescent boys and girls

A new instrument, the Body Change Inventory, was developed to provide an assessment of body change strategies that are used by both adolescent girls and boys. The novel aspect of this instrument is that it evaluates strategies to increase body size and increase muscle size, as well strategies to decrease body size. Independent samples of adolescent girls and boys aged between 11 and 17 years (N=1732) participated in four studies. The revised instrument consisted of three body change scales—Strategies to Decrease Body Size, Strategies to Increase Body Size, and Strategies to Increase Muscle Size. The studies demonstrated content validity, construct validity, internal consistency, and concurrent and discriminant validity for the new scales. The new scales provide a valuable addition in the literature for assessing three global body change strategies among adolescent girls and boys. They are needed in order to examine further the normative development of different kinds of body change strategies and how these may lead to behavioural problems such as disordered eating, exercise dependence, and steroid use.

Validity and reliability of a physical activity recall instrument among overweight and non-overweight men and women

This study examined the validity and reliability of survey items measuring one-week recall of physical activity (PA) and examined differences by weight status. A sub-aim of the study was to objectively assess the intensity of activity that most closely matches self-report. A questionnaire was administered to adults twice, three days apart. It was again administered after subjects wore a MTI/CSA accelerometer for seven days (n = 118). Several metabolic equivalent (MET) thresholds were applied to the accelerometer data. Agreement between test and re- test estimates of sufficient physical activity for health benefits (150 min/week) was high (% agreement > 90%). Correlations (rho) between total reported PA (mins/day) and accelerometer data were 0.29 (p < 0.05) among men and 0.25 (p < 0.05) among women. Among men, self- reported duration of moderate PA (3-5.9 METS) and accelerometer data were significantly correlated (rho = 0.40, p < 0.01), with no differences by weight status. Among women, a significant relationship was found only for those who were not overweight (rho = 0.52, p < 0.001). A significant correlation between self-reported duration of vigorous PA (6+ METS) and accelerometer data was only found for overweight men (rho = 0.40, p < 0.05). When lower MET thresholds were applied to the accelerometer data, women's reported duration of moderate-intensity PA was most strongly correlated with moderate PA (accelerometer) defined as 2.0-5.9 METS (rho = 0.39, p < 0.01). The recall instrument provides a consistent measure of physical activity and validation coefficients were similar to those obtained for other physical activity recall questionnaires. However, the ability to measure PA by self-report may vary by weight status.

Development, reliability and validity of an instrument measuring the attitudes and knowledge of emergency department staff regarding the emergency nurse practitioner role

Introduction: The Emergency Department (ED) at The Northern Hospital is currently participating in the Victorian Department of Human Services funded Emergency Nurse Practitioner Project. This project aims to develop, implement and evaluate the Emergency Nurse Practitioner role in Victorian EDs. This led to a need to develop a specific data collection tool called The Northern Emergency Nurse Practitioner Staff Survey to examine the knowledge and attitudes of ED medical and nursing staff. This paper describes the development of The Northern Emergency Nurse Practitioner Staff Survey and presents the results of reliability and validity studies. Method: Twenty-five items were developed and piloted on a sample of 58 ED medical and nursing staff. Content and face validity were established by expert panel review. Reliability was established by tests of unidimensionality, exploratory factor analysis and internal consistency. Results: Four items were discarded because of low item to total correlation. Exploratory factor analysis of the remaining items revealed five factors with eigenvalues >1 and acceptable correlation coefficients that explained 76.7% of the variance. Cronbach’s coefficent α for these items was 0.926 indicating a high degree of internal consistency. The factors were titled to reflect the content domain of the items in each factor and the factors arranged in a logical sequence to form the final version of The Northern Emergency Nurse Practitioner Survey.

Development of an instrument to evaluate the quality of delivered information systems

Delivered information systems are an integral part of many organisations’ information technology infrastructure. Their dynamic nature creates new challenges, not the least of which is the need to measure the quality/effectiveness of these systems. Given the size of investment in these systems, it would be invaluable for business to formulate a fresh, simple, easy to administer, multi-dimensional instrument capable of measuring the quality of delivered information systems or applications. Such an instrument would provide a practical and efficient means to pinpoint areas that key stakeholders, ranging from end-users to managers, perceive as requiring attention. In this paper, we report on the development of one such instrument. This instrument addresses key areas of performance and uses multiple statements to enhance stakeholders’ understanding of these areas.

The MORTN market orientation instrument - an empirical analysis

This paper focuses on Deshpande and Farley's (1998) MORTN market orientation instrument. Specifically, the paper investigates empirically the factor structure and reliability of the supposedly unidimensional instrument. When the MORTN instrument was tested utilising Australian organisations, a two-dimensional factor structure was found to fit the data more acceptably then the unidimensional structure proposed by Deshpande and Farley. These dimensions may be characterised as being Customer/Market Intelligence (Dimension One) and Customer Service (Dimension Two).

The utility of a workplace injury instrument in prediction of workplace injury

Workplace injuries are common and destructive to persons, organisations, and society. Various instruments presently exist that are designed to assess the factors underlying workplace injury. The study reports on the construct and predictive validity of a 46-item instrument, the safety perception survey (SPS), currently used to assess safety climate in industrial organisations throughout Australia. Initially, factor analysis was conducted on the data from a sample of 1238 employees from nine organisations, which indicated a one-factor solution, was the best fit. A structural equation model (SEM) linking injury rates to the safety climate measure for 16 sub-groups of six industrial organisations indicated that the measure contributed just 23% of the variance in injury rates. Interestingly, the results indicated that the number of employees was a better and more significant predictor of injury (R² = 0.48). It is proposed that the SPS as is would need to be modified significantly from its current form to produce improvements in validity, as in its current form the survey is no more predictive of injury than organisational size. Future research into safety climate measures should incorporate predictive validity analysis on injury rates, as for many organisations; this is a performance outcome measure.

A simplified stroke rehabilitation assessment of movement instrument

Background and Purpose. An efficient, reliable, and valid instrument for assessing motor function in patients with stroke is needed by both clinicians and researchers. To improve administration efficiency, we applied the multidimensional Rasch model to the 30-item, 3-subscale Stroke Rehabilitation Assessment of Movement (STREAM) instrument to produce a concise, reliable, and valid instrument (simplified STREAM [S-STREAM]) for measuring motor function in patients with stroke. Subjects and Methods. The STREAM (consisting of 3 subscales: upper-limb movements, lower-limb movements, and mobility) was administered to 351 subjects with first stroke occurrence and a median time after stroke of 19.5 months. The unidimensionality of each subscale of the STREAM first was verified with unidimensional Rasch analysis. Each subscale of the STREAM then was simplified by deleting redundant items on the basis of expert opinion and the results of the Rasch analysis. The Rasch reliability of the S-STREAM and the concurrent validity of the S-STREAM with the STREAM were examined with multidimensional Rasch analysis and the intraclass correlation coefficient (ICC), respectively. Results. After deleting the items that did not fit the Rasch model, we found that the 8-item upper-limb movement subscale, the 9-item lower-limb movement subscale, and the 10-item mobility subscale assessed single, unidimensional upper-limb movements, lower-limb movements, and mobility, respectively. We selected 5 items from each subscale to construct the S-STREAM and found that the reliability of each subscale of the resulting simplified instrument was high (Rasch reliability coefficients of [greater than or equal to] .91). The agreement between the subscale scores (Rasch estimates) of the S-STREAM and those of the STREAM was excellent (ICC of [greater than or equal to] .99, with a lower limit for the 95% confidence interval of [greater than or equal to] .985), indicating good concurrent validity of the S-STREAM with the STREAM. Discussion and Conclusion. The S-STREAM demonstrates high Rasch reliability, unidimensionality, and concurrent validity with the STREAM in patients with stroke. Furthermore, the S-STREAM is efficient to administer, as it consists of only half the number of items in the original STREAM. Additional studies to examine other psychometric properties (eg, predictive validity and responsiveness) of the S-STREAM or its psychometric properties in various recovery stages after stroke are needed to further establish its utility in both clinical and research settings.

Development of an instrument for the analysis of problem gambling counselling practice

This article provides an overview of the development and validation of a Counsellor Task Analysis (Problem Gambling) [CTA (PG)] instrument undertaken in order to document the activities of counsellors in problem gambling services. The CTA (PG) aims to provide a broad overview of the complexity of the counsellor's role; specify the range of tasks they perform; and document the relationship between the frequency of task performance and the counsellor's beliefs about the importance of the tasks performed.

The CTA (PG) instrument addresses nine dimensions of practice activity through nine subscales, all of which demonstrate internal consistency. It appears to be a strong instrument in terms of its measurement error characteristics for recommending its use with counsellors engaged in the field of gambling. The CTA (PG) gives counsellors the opportunity to document their practice and theories in use when dealing with a problem gambler, a member of the problem gambler's family and the community at large. The psychometric findings reported in this article should be viewed as the preliminary results of an ongoing research effort and further psychometric testing is anticipated.

Early detection of emotional and behavioural problems in children with diabetes: the validity of the child health questionnaire as a screening instrument

Aims: To assess the validity of the Child Health Questionnaire (CHQ) as a screening tool for detecting 'at risk' emotional and behavioural  maladjustment in children with diabetes, using the Behaviour Assessment System for Children (BASC) as a gold standard measure. Methods: CHQ and BASC were administered to 103 parents of children with Type 1 diabetes, aged 7–12 years. Sub-scales of the two measures were compared using Pearson's bivariate correlations. CHQ sensitivity and specificity cut-points were optimized against the BASC borderline category using receiver operating characteristic curves. Results: The BASC Externalizing Problems scale correlated strongly with CHQ Behaviour, Global Behaviour, Mental Health, Family Activities and Family Cohesion scales (r-values −0.68, −0.54, −0.51, −0.59, and −0.42, respectively). BASC Internalizing Problems scale correlated strongly with CHQ Behaviour, Mental Health and Family Cohesion scales (r-values −0.40, −0.43 and −0.45, respectively). Using receiver operating characteristic curve analysis, the CHQ Mental Health scale most effectively identified children classified as borderline on the BASC Internalizing Problems scale (sensitivity 87%, specificity 78%), while the CHQ Global Behaviour scale most effectively identified children classified as borderline on the BASC Externalizing Problems scale (sensitivity 73%, specificity 82%). Conclusions: Significant correlations were seen between the CHQ Global Behaviour and Mental Health scales and the BASC Externalizing and Internalizing scales, respectively. Sequential use of the CHQ, as a screening tool, followed by an established mental health measure such as the BASC, may help identify children with diabetes 'at risk' for chronic maladjustment and poor health outcomes.

Validity of the assessment of quality of life (AQoL) utility instrument in patients with operable and inoperable lung cancer

There have been few longitudinal studies of quality of life in patients with all stages of lung cancer, particularly those that have included measures of utility. The purpose of this study was to examine the psychometric properties of the Assessment of Quality of Life instrument (AQoL) in patients with lung cancer. The AQoL is a health-related quality of life questionnaire and provides a descriptive system for a multi-attribute utility instrument (MAU), so that scores can be used in cost-utility evaluations. In the present study the reliability (internal consistency) of the AQoL was examined and the concurrent validity was assessed using the Medical Outcomes 36-item Short Form Health Survey (SF-36) as the comparator instrument. The sensitivity to different health states of the AQoL and the responsiveness to change over time was also examined. A prospective, non-experimental cohort study was undertaken. Ninety-two participants with all stages of lung cancer were recruited from a tertiary multi-disciplinary lung cancer clinic. Ninety participants had non-small cell lung cancer (NSCLC) and two had limited stage small cell lung cancer. The AQOL and SF-36 surveys were administered concurrently at baseline. In patients with NSCLC the surveys were then repeated 3 and 6 months later. Correlations between the baseline AQoL summary scales and SF-36 summary scales support the divergent and convergent validity of the AQoL. Reliability was also found to be sufficient (Cronbach's Alpha = 0.76). In addition, in patients with inoperable NSCLC, baseline AQoL scores were found to be predictive of survival at 6 months in Cox proportional hazards multivariate analysis. However, the physical components summary score of the SF-36 was more sensitive to differences in health states between patients with different stages of NSCLC at 6 months of follow-up and more responsive to change over time in both operable and inoperable patients with NSCLC than the AQoL. The findings support the construct validity and reliability of the AQoL in this population. However, there remains some uncertainty about whether the AQoL has sufficient sensitivity to different health states in this population. Further studies using other MAU instruments may determine whether alternative instruments are more sensitive to different health states in individuals with lung cancer.

The performance of solarscan : an automated dermoscopy image analysis instrument for the diagnosis of primary melanoma

Objective To describe the diagnostic performance of SolarScan (Polartechnics Ltd, Sydney, Australia), an automated instrument for the diagnosis of primary melanoma.

Design Images from a data set of 2430 lesions (382 were melanomas; median Breslow thickness, 0.36 mm) were divided into a training set and an independent test set at a ratio of approximately 2:1. A diagnostic algorithm (absolute diagnosis of melanoma vs benign lesion and estimated probability of melanoma) was developed and its performance described on the test set. High-quality clinical and dermoscopy images with a detailed patient history for 78 lesions (13 of which were melanomas) from the test set were given to various clinicians to compare their diagnostic accuracy with that of SolarScan.

Setting Seven specialist referral centers and 2 general practice skin cancer clinics from 3 continents. Comparison between clinician diagnosis and SolarScan diagnosis was by 3 dermoscopy experts, 4 dermatologists, 3 trainee dermatologists, and 3 general practitioners.

Patients Images of the melanocytic lesions were obtained from patients who required either excision or digital monitoring to exclude malignancy.

Main Outcome Measures Sensitivity, specificity, the area under the receiver operator characteristic curve, median probability for the diagnosis of melanoma, a direct comparison of SolarScan with diagnoses performed by humans, and interinstrument and intrainstrument reproducibility.

Results The melanocytic-only diagnostic model was highly reproducible in the test set and gave a sensitivity of 91% (95% confidence interval [CI], 86%-96%) and specificity of 68% (95% CI, 64%-72%) for melanoma. SolarScan had comparable or superior sensitivity and specificity (85% vs 65%) compared with those of experts (90% vs 59%), dermatologists (81% vs 60%), trainees (85% vs 36%; P =.06), and general practitioners (62% vs 63%). The intraclass correlation coefficient of intrainstrument repeatability was 0.86 (95% CI, 0.83-0.88), indicating an excellent repeatability. There was no significant interinstrument variation (P = .80).

Conclusions SolarScan is a robust diagnostic instrument for pigmented or partially pigmented melanocytic lesions of the skin. Preliminary data suggest that its performance is comparable or superior to that of a range of clinician groups. However, these findings should be confirmed in a formal clinical trial.

A usability instrument for evaluating websites-navigation elements

Many small businesses websites have become an important advertising medium. However little consideration is given to how these websites might be made more effective. Many factors impact on website effectiveness, including navigation. Research here describes a usability instrument developed for evaluating small business websites and uses navigation as an example of its application. The research found that the quality of navigation does have an impact on ease-of-use of a site, user's emotional response and frustration levels and a user's intention to return to that website. The research also established the statistically significant elements that contribute to navigation.