A review of the psychometric properties of the Health of the Nation Outcomes Scales (HoNOS) family of measures

BACKGROUND: The Health of the Nation Outcome Scales was developed to routinely measure outcomes for adults with mental illness. Comparable instruments were also developed for children and adolescents (the Health of the Nation Outcome Scales for Children and Adolescents) and older people (the Health of the Nation Outcome Scales 65+). All three are being widely used as outcome measures in the United Kingdom, Australia and New Zealand. There is, however, no comprehensive review of these instruments. This paper fills this gap by reviewing the psychometric properties of each. METHOD: Articles and reports relating to the instruments were retrieved, and their findings synthesised to assess the instruments' validity (content, construct, concurrent, predictive), reliability (test-retest, inter-rater), sensitivity to change, and feasibility/utility. RESULTS: Mostly, the instruments perform adequately or better on most dimensions, although some of their psychometric properties warrant closer examination. CONCLUSION: Collectively, the Health of the Nation Outcome Scales family of measures can assess outcomes for different groups on a range of mental health-related constructs, and can be regarded as appropriate for routinely monitoring outcomes.

Confirmatory factor analysis and psychometric properties of the Anxiety Sensitivity Index-Revised in clinical and normative populations

The present investigation aimed to critically examine the factor structure and psychometric properties of the Anxiety Sensitivity Index - Revised (ASI-R). Confirmatory factor analysis using a clinical sample of adults (N = 248) revealed that the ASI-R could be improved substantially through the removal of 15 problematic items in order to account for the most robust dimensions of anxiety sensitivity. This modified scale was renamed the 21-item Anxiety Sensitivity Index (21-item ASI) and reanalyzed with a large sample of normative adults (N = 435), revealing configural and metric invariance across groups. Further comparisons with other alternative models, using multi-sample analysis, indicated the 21-item ASI to be the best fitting model for both groups. There was also evidence of internal consistency, test-retest reliability, and construct validity for both samples suggesting that the 21-item ASI is a useful assessment device for investigating the construct of anxiety sensitivity in both clinical and normative populations.

Psychometric assessment of recovery from mild traumatic brain injury

The Rapid Screen of Concussion (RSC) is a brief psychometric test battery, designed to provide a functional criterion to aid clinical diagnosis of mild traumatic brain injury (mTBI). The present research aimed to examine the utility of this instrument for assessing recovery after mTBI. Three studies were conducted. In Study 1, Discriminant Function Analysis was performed to determine how well the RSC differentiated uninjured controls (N¼16), from mTBI patients (N¼22) and moderate to severe TBI patients (N¼14), several months post-injury. As predicted, moderate to severe TBI patients achieved lower scores than the mTBI and control groups. The RSC also successfully differentiated between each of the diagnostic groups, yielding an overall correct classification rate of 75%. Study 2 examined the predictive utility of the RSC in the mTBI sample (N¼22). Acute injury performance on the RSC was correlated with post-injury scores at an average of 5.5 months post-injury. Statistically significant partial correlation coefficients (r¼0.53r¼0.80) were found for each of the subtests, showing that low acute RSC scores were predictive of poor recovery scores on the RSC after mTBI. In the third study, Reliable Change Indices were calculated on the RSC subtests to examine individual patterns of recovery from mTBI. While 17 of the 23 participants made a significant improvement on their acute injury DSST scores (74%), only 13 of 25 made a significant improvement on the Rapid Sentence Judgement Test (52%), highlighting differential recovery of function, and challenging the notion of full recovery from mTBI within 3 months. These overall results offer support for the construct and predictive validity of the RSC and demonstrate that inexpensive tests of brain function may be useful for managing mTBI acutely for prognosis.

Psychometric properties of the Chinese version of the diabetes empowerment scale

Metabolic control is central to positive clinical outcome in patients with diabetes. Empowerment has been linked to metabolic control in this clinical group. The current study sought to determine key psychometric properties of the Chinese version of the Diabetes Empowerment Scale (C-DES) and to explore the relationship of the C-DES sub-scales to metabolic control in 189 patients with a diagnosis of diabetes. Confirmatory factor analysis established that the five sub-scales of the C-DES offered a highly satisfactory fit to the data. Furthermore, C-DES sub-scales were found to have generally acceptable internal consistency and divergent reliability. However, convergent reliability of C-DES sub-scales could not be established against metabolic control. It is concluded that future research needs to address ambiguities in the relationship between empowerment and metabolic control in order to afford patients an evidenced-based treatment package to assure optimal metabolic control.

An examination of the psychometric properties of the Rosenberg Self-Esteem Scale (RSES) in Chinese acute coronary syndrome (ACS) patients

The psychometric properties of the Rosenberg Self-Esteem Scale (RSES) as a clinical research instrument for acute coronary syndrome (ACS) patients were investigated in a translated Chinese version of the instrument. A confirmatory factor analysis was conducted on the RSES to establish its psychometric properties in 128 ACS patients over two observation points (within 1 week and 6 months post-admission for ACS). Internal and test - retest reliability of the RSES-TOT (all-items) and RSES-POS sub-scale (positively valenced items) were found to be acceptable. The RSES-NEG sub-scale (negatively valenced items) lacked acceptable internal reliability. The underlying factor structure of the RSES comprised two distinct but related factors, though there was inconsistency in best model fit indices at the 1-week observation point. The use of the RSES as two sub-scales (RSES-POS and RSES-NEG) may be clinically useful in evaluating the influence of this important psychological construct on the health outcomes of patients with ACS. Directions for future research are indicated.

The psychometric properties of a psychosis screen in a correctional setting

Many people who go to gaol are mentally ill. Remandees, prisoner receptions or people in jails have a substantially higher rate of severe mental disorder than other prisoners and the general population. There are no completely satisfactory ways to screen for psychosis and few existing screening questionnaires are available for use in correctional establishments. The Screening Instrument for Psychosis (PS) was developed in the context of the Australian Mental Health Survey: Study of Low Prevalence Disorders. It can help indicate whether a person should be referred to mental health professional for a diagnostic evaluation and possible treatment and/or diversion. We trialled the PS in a high security remand and reception centre. Measures of validity and reliability are reported. (c) 2006 Published by Elsevier Inc.

+Psychometric evaluation of the MacDQoL individualised measure of the impact of macular degeneration on quality of life

Background: The MacDQoL is an individualised measure of the impact of macular degeneration (MD) on quality of life (QoL). There is preliminary evidence of its psychometric properties and sensitivity to severity of MD. The aim of this study was to carry out further psychometric evaluation with a larger sample and investigate the measure's sensitivity to MD severity. Methods: Patients with MD (n = 156: 99 women, 57 men, mean age 79 ± 13 years), recruited from eye clinics (one NHS, one private) completed the MacDQoL by telephone interview and later underwent a clinic vision assessment including near and distance visual acuity (VA), comfortable near VA, contrast sensitivity, colour recognition, recovery from glare and presence or absence of distortion or scotoma in the central 10° of the visual field. Results: The completion rate for the MacDQoL items was 99.8%. Of the 26 items, three were dropped from the measure due to redundancy. A fourth was retained in the questionnaire but excluded when computing the scale score. Principal components analysis and Cronbach's alpha (0.944) supported combining the remaining 22 items in a single scale. Lower MacDQoL scores, indicating more negative impact of MD on QoL, were associated with poorer distance VA (better eye r = -0.431 p < 0.001; worse eye r = -0.350 p < 0.001; binocular vision r = -0.419 p < 0.001) and near VA (better eye r -0.326 p < 0.001; worse eye r = -0.226 p < 0.001; binocular vision r = -0.326 p < 0.001). Poorer MacDQoL scores were associated with poorer contrast sensitivity (better eye r = 0.392 p < 0.001; binocular vision r = 0.423 p < 0.001), poorer colour recognition (r = 0.417 p < 0.001) and poorer comfortable near VA (r = -0.283, p < 0.001). The MacDQoL differentiated between those with and without binocular scotoma (U = 1244 p < 0.001). Conclusion: The MacDQoL 22-item scale has excellent internal consistency reliability and a single-factor structure. The measure is acceptable to respondents and the generic QoL item, MD-specific QoL item and average weighted impact score are related to several measures of vision. The MacDQoL demonstrates that MD has considerable negative impact on many aspects of QoL, particularly independence, leisure activities, dealing with personal affairs and mobility. The measure may be valuable for use in clinical trials and routine clinical care. © 2005 Mitchell et al; licensee BioMed Central Ltd.

The Team Climate Inventory (TCI): a psychometric test on a Taiwanese sample of work groups

Understanding the feasibility of applying the Team Climate Inventory (TCI) in non-Western cultures is essential for researchers attempting to understand the influence of culture on workers' perceived climate. This study describes the application of the TCI in such a setting using data from 203 administrators employed in a Taiwanese medical center. Reliability and factor analyses were performed to establish the feasibility and psychometric properties of the TCI Taiwan version. Reliabilities of both the four- and five-factor solutions exceeded .80. Factor analyses indicated a satisfactory four-factor structure, despite some variations in comparison with the U.K. version. The TCI Taiwan version is feasible and has acceptable psychometric properties. Further research is warranted regarding the degree to which disparities result from cultural differences and the specific nature of organizational systems in Chinese communities.

The slope of the psychometric function and non-stationarity of thresholds in spatiotemporal contrast vision

The slope of the two-interval, forced-choice psychometric function (e.g. the Weibull parameter, ß) provides valuable information about the relationship between contrast sensitivity and signal strength. However, little is known about how or whether ß varies with stimulus parameters such as spatiotemporal frequency and stimulus size and shape. A second unresolved issue concerns the best way to estimate the slope of the psychometric function. For example, if an observer is non-stationary (e.g. their threshold drifts between experimental sessions), ß will be underestimated if curve fitting is performed after collapsing the data across experimental sessions. We measured psychometric functions for 2 experienced observers for 14 different spatiotemporal configurations of pulsed or flickering grating patches and bars on each of 8 days. We found ß ˜ 3 to be fairly constant across almost all conditions, consistent with a fixed nonlinear contrast transducer and/or a constant level of intrinsic stimulus uncertainty (e.g. a square law transducer and a low level of intrinsic uncertainty). Our analysis showed that estimating a single ß from results averaged over several experimental sessions was slightly more accurate than averaging multiple estimates from several experimental sessions. However, the small levels of non-stationarity (SD ˜ 0.8 dB) meant that the difference between the estimates was, in practice, negligible.

Sensory thresholds obtained from MEG data:cortical psychometric functions

Sensory sensitivity is typically measured using behavioural techniques (psychophysics), which rely on observers responding to very large numbers of stimulus presentations. Psychophysics can be problematic when working with special populations, such as children or clinical patients, because they may lack the compliance or cognitive skills to perform the behavioural tasks. We used an auditory gap-detection paradigm to develop an accurate measure of sensory threshold derived from passively-recorded MEG data. Auditory evoked responses were elicited by silent gaps of varying durations in an on-going noise stimulus. Source modelling was used to spatially filter the MEG data and sigmoidal ‘cortical psychometric functions’ relating response amplitude to gap duration were obtained for each individual participant. Fitting the functions with a curve and estimating the gap duration at which the evoked response exceeded one standard deviation of the prestimulus brain activity provided an excellent prediction of psychophysical threshold. Thus we have demonstrated that accurate sensory thresholds can be reliably extracted from MEG data recorded while participants listen passively to a stimulus. Because we required no behavioural task, the method is suitable for studies of populations where variations in cognitive skills or vigilance make traditional psychophysics unsuitable.

Paradoxical psychometric functions ("swan functions") are explained by dilution masking in four stimulus dimensions

The visual system dissects the retinal image into millions of local analyses along numerous visual dimensions. However, our perceptions of the world are not fragmentary, so further processes must be involved in stitching it all back together. Simply summing up the responses would not work because this would convey an increase in image contrast with an increase in the number of mechanisms stimulated. Here, we consider a generic model of signal combination and counter-suppression designed to address this problem. The model is derived and tested for simple stimulus pairings (e.g. A + B), but is readily extended over multiple analysers. The model can account for nonlinear contrast transduction, dilution masking, and signal combination at threshold and above. It also predicts nonmonotonic psychometric functions where sensitivity to signal A in the presence of pedestal B first declines with increasing signal strength (paradoxically dropping below 50% correct in two-interval forced choice), but then rises back up again, producing a contour that follows the wings and neck of a swan. We looked for and found these "swan" functions in four different stimulus dimensions (ocularity, space, orientation, and time), providing some support for our proposal.