A review of the psychometric properties of the Health of the Nation Outcomes Scales (HoNOS) family of measures

BACKGROUND: The Health of the Nation Outcome Scales was developed to routinely measure outcomes for adults with mental illness. Comparable instruments were also developed for children and adolescents (the Health of the Nation Outcome Scales for Children and Adolescents) and older people (the Health of the Nation Outcome Scales 65+). All three are being widely used as outcome measures in the United Kingdom, Australia and New Zealand. There is, however, no comprehensive review of these instruments. This paper fills this gap by reviewing the psychometric properties of each. METHOD: Articles and reports relating to the instruments were retrieved, and their findings synthesised to assess the instruments' validity (content, construct, concurrent, predictive), reliability (test-retest, inter-rater), sensitivity to change, and feasibility/utility. RESULTS: Mostly, the instruments perform adequately or better on most dimensions, although some of their psychometric properties warrant closer examination. CONCLUSION: Collectively, the Health of the Nation Outcome Scales family of measures can assess outcomes for different groups on a range of mental health-related constructs, and can be regarded as appropriate for routinely monitoring outcomes.

Measurement of functional ability following traumatic brain injury using the Clinical Outcomes Variable Scale: A reliability study

This study determined the inter-tester and intra-tester reliability of physiotherapists measuring functional motor ability of traumatic brain injury clients using the Clinical Outcomes Variable Scale (COVS). To test inter-tester reliability, 14 physiotherapists scored the ability of 16 videotaped patients to execute the items that comprise the COVS. Intra-tester reliability was determined by four physiotherapists repeating their assessments after one week, and three months later. The intra-class correlation coefficients (ICC) were very high for both inter-tester reliability (ICC > 0.97 for total COVS scores, ICC > 0.93 for individual COVS items) and intra-tester reliability (ICC > 0.97). This study demonstrates that physiotherapists are reliable in the administration of the COVS.

Effectiveness of hospital-based smoking cessation

Study objectives: Smoking cessation for current smokers is a health-care imperative. It is not clear which approaches to smoking cessation are the most effective in the hospital setting and which factors predict long-term abstinence. We hypothesized that a hospital-based smoking cessation program involving behavioral modification and support would provide an effective intervention for smoking cessation. Design: Prospective cohort study. Setting: Smoking cessation clinics in a tertiary referral, cardiothoracic hospital. Patients or participants: Two hundred forty-three smokers and 187 never-smoker control subjects. Interventions: Smokers underwent specific sessions of individual counseling on behavioral modification, including written information, advice about quit aids, and support during the quit attempt. Abstinence was confirmed by exhaled carbon monoxide measurements. Measurements and results: Compared to never-smoker control subjects, smokers were more likely to have grown up with a smoking father or siblings, and to currently live or socialize with other smokers. Two hundred sixteen smokers attended at least two sessions of the smoking cessation program. Of these, 25% were unavailable for follow-up at 12 months and were assumed to be smoking. The point prevalence abstinence rate at 12 months was 32%. Independent factors associated with abstinence at 12 months were self-belief in quitting ability, having a heart condition, growing up without siblings who smoked, and increasing number of pack-years. Conclusions: This prospective study has demonstrated that this hospital-based smoking cessation program was as effective as programs in other settings. Social and psychological factors were associated with a greater chance of abstinence.

Linking client and employee perceptions of the organization: A study of client satisfaction with health care services

Client satisfaction with health care sen ices has usually been researched in terms of socio-demographic and predispositional characteristics associated with the client. The present study included organizational characteristics as predictors of client satisfaction with health care services. Participants in the research were clients and employees of an Australian public-sector health care organization who responded to separate client and employee questionnaires. Hierarchical regression analyses indicated that, after controlling for a number of client characteristics, organizational characteristics, as perceived by employees, accounted for a significant proportion of additional variance in client satisfaction with health care services. Results of the present study provided some support for the proposition that employee perceptions of the working environment should be considered in a more comprehensive understanding of client satisfaction with health care services. Limitations of the study highlight practical difficulties in the assessment of client outcomes and methodological complexities in linking individual and organizational processes.

Effects of interventions in health care settings on physical activity or cardiorespiratory fitness

Introduction: This paper reviews studies of physical activity interventions in health care settings to determine effects on physical activity and/or fitness and characteristics of successful interventions. Methods: Studies testing interventions to promote physical activity in health care settings for primary prevention (patients without disease) and secondary prevention (patients with cardiovascular disease [CVD]) were identified by computerized search methods and reference lists of reviews and articles. Inclusion criteria included assignment to intervention and control groups, physical activity or cardiorespiratory fitness outcome measures, and, for the secondary prevention studies, measurement 12 or more months after randomization. The number of studies with statistically significant effects was determined overall as well as for studies testing interventions with various characteristics. Results: Twelve studies of primary prevention were identified, seven of which were randomized. Three of four randomized studies with short-term measurement (4 weeks to 3 months after randomization), and two of five randomized studies with long-term measurement (6 months after randomization) achieved significant effects on physical activity. Twenty-four randomized studies of CVD secondary prevention were identified; 13 achieved significant effects on activity and/or fitness at twelve or more months. Studies with measurement at two time points showed decaying effects over time, particularly if the intervention were discontinued. Successful interventions contained multiple contacts, behavioral approaches, supervised exercise, provision of equipment, and/or continuing intervention. Many studies had methodologic problems such as low follow-up rates. Conclusion: Interventions in health care settings can increase physical activity for both primary and secondary prevention. Long-term effects are more likely with continuing intervention and multiple intervention components such as supervised exercise, provision of equipment, and behavioral approaches. Recommendations for additional research are given.

Functional assessment and care of children with neurodevelopmental disabilities

Objectives: To determine the relationship between pediatric assessment scores and ratings by parents and teachers regarding the amount of assistance required to complete basic activities of daily living; and to examine the relationship among scores for three commonly used pediatric assessments. Design: Prospective correlational study. 205 children with developmental disabilities. The children ranged in age from 11 to 87 mo and included 72 females and 133 males of diverse socioeconomic and ethnic backgrounds. The children were evaluated by using the Battelle Developmental Inventory Screening Test, Vineland Adaptive Behavior Scales, Functional Independence Measure for Children (WeeFIM(TM) instrument), and the Amount of Assistance Questionnaire, Results: The test-retest reliability coefficients for items on the Amount of Assistance Questionnaire were found to range from 0.82 to 0.97. Correlations among subscale scores and amount of assistance ratings were highest for the WeeFIM instrument and Battelle Developmental Inventory Screening Test. The highest correlation was between WeeFIM total rating and total amount of assistance rating (r = 0.91). Conclusion: Total WeeFIM instrument ratings and severity of disability were the best predictors of amount of assistance ratings provided by parents and teachers.

Assessing perceived need for mental health care in a community survey: development of the Perceived Need for Care Questionnaire (PNCQ)

Background: The Perceived Need for Care Questionnaire (PNCQ) was designed for the Australian National Survey of Mental Health and Wellbeing. The PNCQ complemented collection of data on diagnosis and disability with the survey participants' perceptions of their needs for mental health care and the meeting of those needs. The four-stage design of the PNCQ mimics a conversational exploration of the topic of perceived needs. Five categories of perceived need are each assigned to one of four levels of perceived need (no need, unmet need, partially met need and met need). For unmet need and partially met need, information on barriers to care is collected, Methods: Inter-rater reliabilities of perceived needs assessed by the PNCQ were examined in a study of 145 anxiety clinic attenders. Construct validity of these items was tested, using a multi-trait multi-method approach and hypotheses regarding extreme groups, in a study with a sample of 51 general practice and community psychiatric service patients. Results: The instrument is brief to administer and has proved feasible for use in various settings. Inter-rater reliabilities for major categories, measured by the kappa statistic, exceeded 0.60 in most cases; for the summary category of all perceived needs, inter-rater reliability was 0.62. The multi-trait multi-method approach lent support to the construct validity of the instrument, as did findings in extreme groups. Conclusions: The PNCQ shows acceptable feasibility, reliability and validity, adding to the range of assessment tools available for epidemiological and health services research.

Perceived need for mental health care: influences of diagnosis, demography and disability

Background. Recent major epidemiological studies have adopted increasingly multidimensional approaches to assessment. Several of these have included some assessment of perceived need for mental health care. The Australian National Survey of Mental Health and Wellbeing, conducted in 1997, included a particularly detailed examination of this construct, with an instrument with demonstrated reliability and validity. Methods. A clustered probability sample of 10641 Australians responded to the field questionnaire for this survey, including questions on perceived need either where there had been service utilization, or where a disorder was detected by administration of sections of the Composite International Diagnostic Interview. The confidentialized unit record file generated from the survey was analysed for determinants of perceived need. Results. Perceived need is increased in females, in people in the middle years of adulthood, and in those who have affective disorders or co-morbidity. Effects of diagnosis and disability can account for most of the differences in gender specific rates. With correction for these effects through regression, there is less perceived need for social interventions and possibly more for counselling in females; disability is confirmed as strongly positively associated with perceived need, as are the presence of affective disorders or co-morbidity. Conclusions. The findings of this study underscore the imperative for mental health services to be attentive and responsive to consumer perceived need. The substantial majority of people who are significantly disabled by mental health problems are among those who see themselves as having such needs.

An evaluation approach for a new paradigm - health care integration

This paper explores an approach to the implementation and evaluation of integrated health service delivery. It identifies the key issues involved in integration evaluation, provides a framework for assessment and identifies areas for the development of new tools and measures. A proactive role for evaluators in responding to health service reform is advocated.

Using a problem detection study (PDS) to identify and compare health care provider and consumer views of antihypertensive therapy

The objectives of this study were to ascertain consumer knowledge and behaviour about hypertension and treatment and to compare these with health care providers' perceptions (of 'most' consumers). The design for the study was a problem detection study (PDS): focus groups and then survey. Focus groups and survey participants were convenience samples of consumers, doctors, nurses and pharmacists. The main outcome measures were agreement on a 5-point Likert scale with statements about consumers' knowledge and behaviour about high blood pressure and medication. The survey identified areas of consensus and disagreement between consumers and health providers. While general knowledge and concordance with antihypertensive therapy among consumers was good, consequences such as eye and kidney disease, interactions with herbal medicines, and how to deal with missing a dose were less well known. Side effects were a problem for over one-quarter of participants, and cost was a problem in continuing therapy. Half the consumers had not received sufficient written information. Providers overall disagreed that most consumers have an adequate understanding of the condition. They agreed that most consumers adhere to therapy and can manage medicines; and about their own profession's role in information provision and condition management. Consumers confirmed positive provider behaviour, suggesting opportunities for greater communication between providers about actions taken with their consumers. In conclusion, the PDS methodology was useful in identifying consumer opinions. Differences between consumer and provider responses were marked, with consumers generally rating their knowledge and behaviour above providers' ratings of 'most' consumers. There are clear gaps to be targeted to improve the outcomes of hypertension therapy.

Meeting in the middle: Improving communication in primary health care consultations with people with an intellectual disability

The increased presence and participation in Australian society of people with an intellectual disability provides challenges for the provision of primary health care. General practitioners (GPs) identify themselves as ill equipped to provide for this heterogeneous population. A major obstacle to the provision of appropriate health care is seen as inadequate communication between the GP and the person with an intellectual disability, who may or may not be accompanied by a carer or advocate. This qualitative study in which five GPs, three people with intellectual disability, seven carers and two advocates (parent and friend) were interviewed was conducted in Brisbane, Australia. The aim was to better understand the factors that have an impact upon the success of communication in a medical consultation. Findings suggested that GPs were concerned with the aspects of communication difficulties which influenced their ability to adequately diagnose, manage and inform patients. Implications for practice management were also identified. People with intellectual disability reported frustration when they felt that they could not communicate adequately with the GP and annoyance when they were not included in the communication exchange. Carers were strong advocates for the person with intellectual disability, but indicated insufficient skill and knowledge to provide the level of assistance required in the consultation. The outcome was a model of cooperation that outlined the responsibilities of all players in the medical encounter, prior to, during and after the event.

Suicide and recency of health care contacts - A systematic review

Background Many countries have set targets for suicide reduction, and suggested that mental health care providers and general practitioners have a key role to play. Method Asystematic review of the literature. Results Among those in the general population who commit suicide, up to 41% may have contact with psychiatric inpatient care in the year prior to death and up-to 9% may commit suicide within one day of discharge. The corresponding figures are I I and 4% for community-based psychiatric care and 83 and 20% for general practitioners. Conclusions Among those who die by suicide. contact with health services is common before death. This is a necessary but not sufficient condition for clinicians to intervene. More work is needed to determine whether these people show characteristic patterns of care and/or particular risk factors which would enable a targeted approach to be developed to assist clinicians in detecting and managing high-risk patients.