The validity of the MacNew Quality of Life Questionnaire in heart disease.

Background A previous review suggested that the MacNew Quality of Life Questionnaire was the most appropriate disease-specific measure of health-related quality of life among people with ischaemic heart disease. However, there is ambiguity about the allocation of items to the three factors underlying the MacNew and the factor structure has not been confirmed previously among the people in the UK. Methods The MacNew Questionnaire and the SF-36 were administered to 117 newly admitted patients to a tertiary referral centre in Northern Ireland. All patients had been diagnosed with ischaemic heart disease. Results A confirmatory factor analysis was conducted on the factor structure of the MacNew and the model was found to be an inadequate fit of the data. A quantitative and qualitative analysis of the items suggested that a five factor solution was more appropriate and this was validated by confirmatory factor analysis. This new structure also displayed strong evidence of concurrent validity when compared to the SF-36. Conclusion We recommend that researchers should submit scores obtained from items on the MacNew to secondary analyses after being grouped according to the factor structure proposed in this paper, in order to explore further the most appropriate grouping of items.

Measuring the health-related quality of life of people with ischaemic heart disease.

Objectives—To inform researchers and clinicians about the most appropriate generic and disease specific measures of health related quality of life for use among people with ischaemic heart disease. Methods—MEDLINE and BIDS were searched for research papers which contained a report of at least one of the three most common generic instruments or at least one of the five disease specific instruments used with ischaemic heart disease patients. Evidence for the validity, reliability, and sensitivity of these instruments was critically appraised. Results—Of the three generic measures—the Nottingham health profile, sickness impact profile, and short form 36 (SF-36)—the SF-36 appears to offer the most reliable, valid, and sensitive assessment of quality of life. However, a few of the SF-36 subscales lack a sufficient degree of sensitivity to detect change in a patient’s clinical condition. According to the best available evidence, the quality of life after myocardial infarction questionnaire should be preferred to the Seattle angina questionnaire, the quality of life index cardiac version, the angina pectoris quality of life questionnaire, and the summary index. Overall, research on disease specific measures is sparse compared to the number of studies which have investigated generic measures. Conclusions—An assessment of the quality of life of people with ischaemic heart disease should comprise a disease specific measure in addition to a generic measure. The SF-36 and the quality of life after myocardial infarction questionnaire (version 2) are the most appropriate currently available generic and disease specific measures of health related quality of life, respectively. Further research into the measurement of health related quality of life of people with ischaemic heart disease is required in order to address the problems (such as lack of sensitivity to detect change) identified by the review.

Generic, disease-specific and individualised approaches to measuring health-related quality of life among people with heart disease - a comparative analysis.

Increasing emphasis is being placed on the evaluation of health-related quality of life. However, there is no consensus on the definition of this concept and as a result there are a plethora of existing measurement instruments. Head-to-head comparisons of the psychometric properties of existing instruments are necessary to facilitate evidence-based decisions about which instrument should be chosen for routine use. Therefore, an individualised instrument (the modified Patient Generated Index), a generic instrument (the Short Form 36) and a disease-specific instrument (the Quality of Life after Myocardial Infarction questionnaire) were administered to patients with ischaemic heart disease (n=117) and the evidence for the validity, reliability and sensitivity of each instrument was examined and compared. The modified Patient Generated Index compared favourably with the other instruments but none of the instruments examined provided sound evidence for sensitivity to change. Therefore, any recommendation for the use of the individualised approach in the routine collection of health-related quality of life data in clinical practice must be conditional upon the submission of further evidence to support the sensitivity of such instruments.

Validity, trustworthiness and rigour:reasserting realism in qualitative research

Aim The aim of this paper is to challenge recent sceptical approaches to the possibility of validating qualitative research and to underline the benefits of adopting a realist approach to validity. Background In recent discussion about the methodological bases for qualitative research it has been argued that, because different methodologies take different approaches to validity, attempts to develop a common set of validation criteria are futile. On the basis of this sceptical view, a number of strategies for judging qualitative research have been proposed. These include suggestions that: it should be judged according to aesthetic or rhetorical criteria, rather than epistemological validity; responsibility for appraisal should move from researchers to readers; each methodology should be assessed individually according to its own merits. Discussion None of these suggestions provide a viable alternative to validity, defined as the extent to which research reflects accurately that to which it refers. Because the form of research does not determine its content, replacement of epistemology by aesthetics is unsustainable. Because research reports mediate between writer and reader, a one-sided approach to this relationship constitutes a false dichotomy. If we accept the criterion of practitioner confidence as a means of judging methodological approaches, this involves rejection of judgement according to a methodology�s own merits. Conclusion If qualitative research is actually about something, and if it is required to provide beneficial information, then a realist approach to validity holds out greatest promise.

The validity of a latent class typology of adolescent drinking patterns

Objectives: This study examined the validity of a latent class typology of adolescent drinking based on four alcohol dimensions; frequency of drinking, quantity consumed, frequency of binge drinking and the number of alcohol related problems encountered. Method: Data used were from the 1970 British Cohort Study sixteen-year-old follow-up. Partial or complete responses to the selected alcohol measures were provided by 6,516 cohort members. The data were collected via a series of postal questionnaires. Results: A five class LCA typology was constructed. Around 12% of the sample were classified as �hazardous drinkers� reporting frequent drinking, high levels of alcohol consumed, frequent binge drinking and multiple alcohol related problems. Multinomial logistic regression, with multiple imputation for missing data, was used to assess the covariates of adolescent drinking patterns. Hazardous drinking was associated with being white, being male, having heavy drinking parents (in particular fathers), smoking, illicit drug use, and minor and violent offending behaviour. Non-significant associations were found between drinking patterns and general mental health and attention deficient disorder. Conclusion: The latent class typology exhibited concurrent validity in terms of its ability to distinguish respondents across a number of alcohol and non-alcohol indicators. Notwithstanding a number of limitations, latent class analysis offers an alternative data reduction method for the construction of drinking typologies that addresses known weaknesses inherent in more tradition classification methods.

A measure of satisfaction with food-related life

A measure of satisfaction with food-related life is developed and tested in three studies in eight European countries. Five items are retained from an original pool of seven; these items exhibit good reliability as measured by Cronbach's alpha, good temporal stability, convergent validity with two related measures, and construct validity as indicated by relationships with other indicators of quality of life, including the Satisfaction With Life and the SF-8 scales. It is concluded that this scale will be useful in studies trying to identify factors contributing to satisfaction with food-related life.

A systematic review of instruments related to family caregivers of palliative care patients

Support for family caregivers is a core function of palliative care. However, there is a lack of consistency in the way needs are assessed, few longitudinal studies to examine the impact of caregiving, and a dearth of evidence-based interventions. In order to help redress this situation, identification of suitable instruments to examine the caregiving experience and the effectiveness of interventions is required. A systematic literature review was undertaken incorporating representatives of the European Association for Palliative Care’s International Palliative Care Family Caregiver Research Collaboration and Family Carer Taskforce. The aim of the review was to identify articles that described the use of instruments administered to family caregivers of palliative care patients (pre and post-bereavement). Fourteen of the 62 instruments targeted satisfaction with service delivery and less than half were developed specifically for the palliative care context. In approximately 25% of articles psychometric data were not reported. Where psychometric results were reported, validity data were reported in less than half (42%) of these cases. While a considerable variety of instruments have been administered to family caregivers, the validity of some of these requires further consideration. We recommend that others be judicious before developing new instruments for this population.

Factor structure and validity of the Alcohol Use Disorders Identification Test (AUDIT) in a sample of mentally disordered offenders

Investigations of the factor structure of the Alcohol Use Disorders Identification Test (AUDIT) have produced conflicting results. The current study assessed the factor structure of the AUDIT for a group of Mentally Disordered Offenders (MDOs) and examined the pattern of scoring in specific subgroups. The sample comprised 2005 MDOs who completed a battery of tests including the AUDIT. Confirmatory factor analyses revealed that a two-factor solution – alcohol consumption and alcohol-related consequences – provided the best data fit for AUDIT scores. A three-factor solution provided an equally good fit, but the second and third factors were highly correlated and a measure of parsimony also favoured the two-factor solution. This study provides useful information on the factor structure of the AUDIT amongst a large MDO population, while also highlighting the difficulties associated with the presence of people with mental health problems in the criminal justice system.

Foveal relocation surgery:Is it a reasonable option for patients with age-related macular degeneration?

Foveal relocation (or translocation) has been reintroduced recently as a possible treatment for patients with subfoveal choroidal neovascular membranes secondary to age-related macular degeneration and degenerative myopia. Different surgical techniques have been proposed and the results, although encouraging, are not completely satisfactory yet. Most surgical procedures described are technically difficult and require special vitreo-retinal expertise. Furthermore, although marked improvements in visual acuity have been observed in some patients, others do not experience visual improvement, even after a successful surgery. Additionally, devastating complications, such as proliferative vitreo-retinopathy (PVR) can occur, impairing the final visual outcome. Although foveal relocation surgery may be a promising direction in research and development, as yet, there is no randomised controlled trial to show that it is more effective than any other forms of treatment for macular degeneration. The validity of this surgical approach needs to be evaluated by the results of longer-term follow-up. This article reviews the current surgical techniques for foveal relocation, their outcomes and complications, and discusses the surgical problems that vitreo-retinal surgeons face when performing foveal relocation surgery.

Validity of the Global Physical Activity Questionnaire (GPAQ) in assessing levels and change in moderate-vigorous physical activity and sedentary behaviour

Background

Feasible, cost-effective instruments are required for the surveillance of moderate-to-vigorous physical activity (MVPA) and sedentary behaviour (SB) and to assess the effects of interventions. However, the evidence base for the validity and reliability of the World Health Organisation-endorsed Global Physical Activity Questionnaire (GPAQ) is limited. We aimed to assess the validity of the GPAQ, compared to accelerometer data in measuring and assessing change in MVPA and SB.

Participants (n = 101) were selected randomly from an on-going research study, stratified by level of physical activity (low, moderate or highly active, based on the GPAQ) and sex. Participants wore an accelerometer (Actigraph GT3X) for seven days and completed a GPAQ on Day 7. This protocol was repeated for a random sub-sample at a second time point, 3–6 months later. Analysis involved Wilcoxon-signed rank tests for differences in measures, Bland-Altman analysis for the agreement between measures for median MVPA and SB mins/day, and Spearman’s rho coefficient for criterion validity and extent of change.

95 participants completed baseline measurements (44 females, 51 males; mean age 44 years, (SD 14); measurements of change were calculated for 41 (21 females, 20 males; mean age 46 years, (SD 14). There was moderate agreement between GPAQ and accelerometer for MVPA mins/day (r = 0.48) and poor agreement for SB (r = 0.19). The absolute mean difference (self-report minus accelerometer) for MVPA was −0.8 mins/day and 348.7 mins/day for SB; and negative bias was found to exist, with those people who were more physically active over-reporting their level of MVPA: those who were more sedentary were less likely to under-report their level of SB. Results for agreement in change over time showed moderate correlation (r = 0.52, p = 0.12) for MVPA and poor correlation for SB (r = −0.024, p = 0.916).

Levels of agreement with objective measurements indicate the GPAQ is a valid measure of MVPA and change in MVPA but is a less valid measure of current levels and change in SB. Thus, GPAQ appears to be an appropriate measure for assessing the effectiveness of interventions to promote MVPA.

Establishing the validity of English GP Patient Survey items evaluating out-of-hours care

Background A 2014 national audit used the English General Practice Patient Survey (GPPS) to compare service users’ experience of out-of-hours general practitioner (GP) services, yet there is no published evidence on the validity of these GPPS items. Objectives Establish the construct and concurrent validity of GPPS items evaluating service users’ experience of GP out-of-hours care. Methods Cross-sectional postal survey of service users (n=1396) of six English out-of-hours providers. Participants reported on four GPPS items evaluating out-of-hours care (three items modified following cognitive interviews with service users), and 14 evaluative items from the Out-of-hours Patient Questionnaire (OPQ). Construct validity was assessed through correlations between any reliable (Cochran's α>0.7) scales, as suggested by a principal component analysis of the modified GPPS items, with the ‘entry access’ (four items) and ‘consultation satisfaction’ (10 items) OPQ subscales. Concurrent validity was determined by investigating whether each modified GPPS item was associated with thematically related items from the OPQ using linear regressions. Results The modified GPPS item-set formed a single scale (α=0.77), which summarised the two-component structure of the OPQ moderately well; explaining 39.7% of variation in the ‘entry access’ scores (r=0.63) and 44.0% of variation in the ‘consultation satisfaction’ scores (r=0.66), demonstrating acceptable construct validity. Concurrent validity was verified as each modified GPPS item was highly associated with a distinct set of related items from the OPQ. Conclusions Minor modifications are required for the English GPPS items evaluating out-of-hours care to improve comprehension by service users. A modified question set was demonstrated to comprise a valid measure of service users’ overall satisfaction with out-of-hours care received. This demonstrates the potential for the use of as few as four items in benchmarking providers and assisting services in identifying, implementing and assessing quality improvement initiatives.

Paving the way for the use of the SDQ in economic evaluations of school-based population health interventions: an empirical analysis of the external validity of SDQ mapping algorithms to the CHU9D in an educational setting

Purpose
The Strengths and Difficulties Questionnaire (SDQ) is a behavioural screening tool for children. The SDQ is increasingly used as the primary outcome measure in population health interventions involving children, but it is not preference based; therefore, its role in allocative economic evaluation is limited. The Child Health Utility 9D (CHU9D) is a generic preference-based health-related quality of-life measure. This study investigates the applicability of the SDQ outcome measure for use in economic evaluations and examines its relationship with the CHU9D by testing previously published mapping algorithms. The aim of the paper is to explore the feasibility of using the SDQ within economic evaluations of school-based population health interventions.
Methods
Data were available from children participating in a cluster randomised controlled trial of the school-based roots of empathy programme in Northern Ireland. Utility was calculated using the original and alternative CHU9D tariffs along with two SDQ mapping algorithms. t tests were performed for pairwise differences in utility values from the preference-based tariffs and mapping algorithms.
Results
Mean (standard deviation) SDQ total difficulties and prosocial scores were 12 (3.2) and 8.3 (2.1). Utility values obtained from the original tariff, alternative tariff, and mapping algorithms using five and three SDQ subscales were 0.84 (0.11), 0.80 (0.13), 0.84 (0.05), and 0.83 (0.04), respectively. Each method for calculating utility produced statistically significantly different values except the original tariff and five SDQ subscale algorithm.
Conclusion
Initial evidence suggests the SDQ and CHU9D are related in some of their measurement properties. The mapping algorithm using five SDQ subscales was found to be optimal in predicting mean child health utility. Future research valuing changes in the SDQ scores would contribute to this research.

Reliability and factorial validity of Adolescent Time Inventory-Time Attitude (ATI-TA) Scores in Scottish and Northern Irish adolescents

The contemporary literature investigating the construct broadly known as time perspective is replete with methodological and conceptual concerns. These concerns focus on the reliability and factorial validity of measurement tools, and the sample-specific modification of scales. These issues continue to hamper the development of this potentially useful psychological construct. An emerging body of evidence has supported the six-factor structure of scores on the Adolescent Time Inventory-Time Attitudes Scale, as well as their reliability. The present study utilized data from the first wave of a longitudinal study in the United Kingdom to examine the reliability, validity, and cross-cultural invariance of the scale. Results showed that the hypothesized six-factor model provided the best fit for the data; all alpha and omega estimates were >. .70; scores on ATI-TA factors related meaningfully to self-efficacy scores; and the factor structure was invariant across both research sites. Results are discussed in the context of the extant temporal literature.

The Reliability and Validity of a Child and Adolescent Participation in Decision Making Questionnaire

Background
There is a growing impetus across the research, policy and practice communities for children and young people to participate in decisions that affect their lives. Furthermore, there is a dearth of general instruments that measure children and young people’s views on their participation in decision making. This paper presents the reliability and validity of the Child and Adolescent Participation in Decision Making Questionnaire (CAP-DMQ) and specifically looks at a population of looked-after children where a lack of participation in decision making is an acute issue.
Methods
The participants were 151 looked after children and adolescents between 10-23 years of age who completed the 10 item CAP-DMQ. Of the participants 113 were in receipt of an advocacy service that had an aim of increasing participation in decision-making with the remaining participants not having received this service.
Results
The results showed that the CAP-DMQ had good reliability (Cronbach’s alpha = .94) and showed promising uni-dimensional construct validity through an exploratory factor analysis. The items in the CAP-DMQ also demonstrated good content validity by overlapping with prominent models of child and adolescent participation (Lundy 2007) and decision making (Halpern 2014). A regression analysis showed that age and gender were not significant predictors of CAP-DMQ scores but receipt of advocacy was a significant predictor of scores (effect size d=.88), thus showing appropriate discriminant criterion validity.
Conclusion
Overall, the CAP-DMQ showed good reliability and validity. Therefore, the measure has excellent promise for theoretical investigation in the area of child and adolescent participation in decision making and equally shows empirical promise for use as a measure in evaluating services which have increasing the participation of children and adolescents in decision making as an intended outcome.