A Rasch analysis of the teachers music confidence scale

This article presents a new measure of teachers’ confidence to conduct musical activities with young children; Teachers Music Confidence Scale (TMCS). The TMCS was developed using a sample of 284 in-service and pre-service early childhood teachers in Hong Kong Special Administrative Region (HKSAR). The TMCS consisted of 10 musical activities. Teachers rated their confidence levels to conduct each activity on a scale from 1 (Not confident at all) to 5 (Very confident). An exploratory factor analysis retained a 10-item single factor that was replicated using confirmatory factor analysis procedures. All items of the TMCS fitted the Rasch model adequately. In-service teachers showed higher confidence levels to conduct several musical activities with young children than pre-service teachers. Implications of these findings for measuring teachers’ confidence to conduct musical activities with young children were discussed.

A simplified stroke rehabilitation assessment of movement instrument

Background and Purpose. An efficient, reliable, and valid instrument for assessing motor function in patients with stroke is needed by both clinicians and researchers. To improve administration efficiency, we applied the multidimensional Rasch model to the 30-item, 3-subscale Stroke Rehabilitation Assessment of Movement (STREAM) instrument to produce a concise, reliable, and valid instrument (simplified STREAM [S-STREAM]) for measuring motor function in patients with stroke. Subjects and Methods. The STREAM (consisting of 3 subscales: upper-limb movements, lower-limb movements, and mobility) was administered to 351 subjects with first stroke occurrence and a median time after stroke of 19.5 months. The unidimensionality of each subscale of the STREAM first was verified with unidimensional Rasch analysis. Each subscale of the STREAM then was simplified by deleting redundant items on the basis of expert opinion and the results of the Rasch analysis. The Rasch reliability of the S-STREAM and the concurrent validity of the S-STREAM with the STREAM were examined with multidimensional Rasch analysis and the intraclass correlation coefficient (ICC), respectively. Results. After deleting the items that did not fit the Rasch model, we found that the 8-item upper-limb movement subscale, the 9-item lower-limb movement subscale, and the 10-item mobility subscale assessed single, unidimensional upper-limb movements, lower-limb movements, and mobility, respectively. We selected 5 items from each subscale to construct the S-STREAM and found that the reliability of each subscale of the resulting simplified instrument was high (Rasch reliability coefficients of [greater than or equal to] .91). The agreement between the subscale scores (Rasch estimates) of the S-STREAM and those of the STREAM was excellent (ICC of [greater than or equal to] .99, with a lower limit for the 95% confidence interval of [greater than or equal to] .985), indicating good concurrent validity of the S-STREAM with the STREAM. Discussion and Conclusion. The S-STREAM demonstrates high Rasch reliability, unidimensionality, and concurrent validity with the STREAM in patients with stroke. Furthermore, the S-STREAM is efficient to administer, as it consists of only half the number of items in the original STREAM. Additional studies to examine other psychometric properties (eg, predictive validity and responsiveness) of the S-STREAM or its psychometric properties in various recovery stages after stroke are needed to further establish its utility in both clinical and research settings.

Screening children with developmental coordination disorder : the development of the caregiver assessment of movement participation

This study investigated the psychometric properties of the Caregiver Assessment of Movement Participation (CAMP), which was developed to measure and identify children with movement participation problems in home contexts. The test-retest reliability, as well as the concurrent and contrast-group validity of the 35-item parent-proxy CAMP, was examined on 312 children aged 5 to 8 years using intraclass correlation, factor analysis, and the Rasch model. Initial findings on the CAMP appeared to support its validity. Testing on other properties from a practical perspective, such as finding the best rating scale structure and cutpoints, are recommended before using the instrument for child health surveillance screening.

Performance of the assessment of quality of life measure in people with hip and knee joint disease and implications for research and clinical use

Objective
To comprehensively evaluate the performance of the Assessment of Quality of Life (AQoL) instrument for measuring health-related quality of life (HRQOL) in people with hip and knee joint disease (arthritis or osteoarthritis).

Methods
Data from 237 individuals were available for analysis from a national cross-sectional, population-based study of hip and knee joint disease in Australia. AQoL-4D data were evaluated using Rasch analysis. A range of measurement properties was explored, including model and item fit, threshold ordering, differential item functioning, and targeting.

Results
Good overall fit of the AQoL with the Rasch model was demonstrated across a range of tests, supporting internal validity. Only 1 item (relating to hearing) showed evidence of misfit. Most AQoL items showed logical sequencing of response option categories, with threshold disordering evident for only 2 of the 12 items (items 4 and 9). Minor issues with potential clinical and research implications include limited options for reporting pain and some evidence of measurement bias between demographic subgroups (including age and sex). Participants' HRQOL was generally better than that represented by the AQoL items (mean ± SD for person abilities −2.15 ± 1.39, mean ± SD for item difficulties 0.00 ± 0.67), indicating ceiling effects that could impact the instrument's ability to detect HRQOL improvement in population-based studies.

Conclusion
The AQoL is a competent tool for assessing HRQOL in people with hip and knee joint disease, although researchers and clinicians should consider the caveats identified when selecting appropriate HRQOL measures for future outcome assessment involving this patient group.

Measuring nursing competencies in the operating theatre: instrument development and psychometric analysis using Item Response Theory

BACKGROUND: Concern about the process of identifying underlying competencies that contribute to effective nursing performance has been debated with a lack of consensus surrounding an approved measurement instrument for assessing clinical performance. Although a number of methodologies are noted in the development of competency-based assessment measures, these studies are not without criticism. RESEARCH AIM: The primary aim of the study was to develop and validate a Performance Based Scoring Rubric, which included both analytical and holistic scales. The aim included examining the validity and reliability of the rubric, which was designed to measure clinical competencies in the operating theatre. RESEARCH METHOD: The fieldwork observations of 32 nurse educators and preceptors assessing the performance of 95 instrument nurses in the operating theatre were used in the calibration of the rubric. The Rasch model, a particular model among Item Response Models, was used in the calibration of each item in the rubric in an attempt at improving the measurement properties of the scale. This is done by establishing the 'fit' of the data to the conditions demanded by the Rasch model. RESULTS: Acceptable reliability estimates, specifically a high Cronbach's alpha reliability coefficient (0.940), as well as empirical support for construct and criterion validity for the rubric were achieved. Calibration of the Performance Based Scoring Rubric using Rasch model revealed that the fit statistics for most items were acceptable. CONCLUSION: The use of the Rasch model offers a number of features in developing and refining healthcare competency-based assessments, improving confidence in measuring clinical performance. The Rasch model was shown to be useful in developing and validating a competency-based assessment for measuring the competence of the instrument nurse in the operating theatre with implications for use in other areas of nursing practice.