The validity of the MacNew Quality of Life Questionnaire in heart disease.

Background A previous review suggested that the MacNew Quality of Life Questionnaire was the most appropriate disease-specific measure of health-related quality of life among people with ischaemic heart disease. However, there is ambiguity about the allocation of items to the three factors underlying the MacNew and the factor structure has not been confirmed previously among the people in the UK. Methods The MacNew Questionnaire and the SF-36 were administered to 117 newly admitted patients to a tertiary referral centre in Northern Ireland. All patients had been diagnosed with ischaemic heart disease. Results A confirmatory factor analysis was conducted on the factor structure of the MacNew and the model was found to be an inadequate fit of the data. A quantitative and qualitative analysis of the items suggested that a five factor solution was more appropriate and this was validated by confirmatory factor analysis. This new structure also displayed strong evidence of concurrent validity when compared to the SF-36. Conclusion We recommend that researchers should submit scores obtained from items on the MacNew to secondary analyses after being grouped according to the factor structure proposed in this paper, in order to explore further the most appropriate grouping of items.

The validity of a latent class typology of adolescent drinking patterns

Objectives: This study examined the validity of a latent class typology of adolescent drinking based on four alcohol dimensions; frequency of drinking, quantity consumed, frequency of binge drinking and the number of alcohol related problems encountered. Method: Data used were from the 1970 British Cohort Study sixteen-year-old follow-up. Partial or complete responses to the selected alcohol measures were provided by 6,516 cohort members. The data were collected via a series of postal questionnaires. Results: A five class LCA typology was constructed. Around 12% of the sample were classified as �hazardous drinkers� reporting frequent drinking, high levels of alcohol consumed, frequent binge drinking and multiple alcohol related problems. Multinomial logistic regression, with multiple imputation for missing data, was used to assess the covariates of adolescent drinking patterns. Hazardous drinking was associated with being white, being male, having heavy drinking parents (in particular fathers), smoking, illicit drug use, and minor and violent offending behaviour. Non-significant associations were found between drinking patterns and general mental health and attention deficient disorder. Conclusion: The latent class typology exhibited concurrent validity in terms of its ability to distinguish respondents across a number of alcohol and non-alcohol indicators. Notwithstanding a number of limitations, latent class analysis offers an alternative data reduction method for the construction of drinking typologies that addresses known weaknesses inherent in more tradition classification methods.

Validity of a 1 minute walk test for children with cerebral palsy.

The concurrent validity of a 1 minute walk test at a child's maximum walking speed was assessed in children with bilateral spastic cerebral palsy (BSCP). The distance covered during the 1 minute walk test was compared with the children's gross motor function as assessed by the Gross Motor Function Measure (GMFM). Twenty-four male and 10 female children with CP (mean age 11y, range 4 to 16y) participated in the study. Gross Motor Function Classification System (GMFCS) levels were; level I (n=3), level II (n=17), level III (n=10), and level IV (n=4). Participants had clinical diagnoses of symmetrical diplegia (n=19), asymmetrical diplegia (n=14), and quadriplegia (n=1). Results showed a significant correlation between GMFM score and the distance covered during the 1 minute walk (r=0.92; p<0.001). There was also a significant decrease in the distance walked with increasing GMFCS level (p<0.001). We concluded that the 1 minute walk test is a valid measure for assessing functional ability in children with ambulatory BSCP. Its cost-effectiveness and user friendliness make it a potentially useful tool in the clinical setting. Further study needs to address its reliability and ability to detect change over time.

Establishing the validity of English GP Patient Survey items evaluating out-of-hours care

Background A 2014 national audit used the English General Practice Patient Survey (GPPS) to compare service users’ experience of out-of-hours general practitioner (GP) services, yet there is no published evidence on the validity of these GPPS items. Objectives Establish the construct and concurrent validity of GPPS items evaluating service users’ experience of GP out-of-hours care. Methods Cross-sectional postal survey of service users (n=1396) of six English out-of-hours providers. Participants reported on four GPPS items evaluating out-of-hours care (three items modified following cognitive interviews with service users), and 14 evaluative items from the Out-of-hours Patient Questionnaire (OPQ). Construct validity was assessed through correlations between any reliable (Cochran's α>0.7) scales, as suggested by a principal component analysis of the modified GPPS items, with the ‘entry access’ (four items) and ‘consultation satisfaction’ (10 items) OPQ subscales. Concurrent validity was determined by investigating whether each modified GPPS item was associated with thematically related items from the OPQ using linear regressions. Results The modified GPPS item-set formed a single scale (α=0.77), which summarised the two-component structure of the OPQ moderately well; explaining 39.7% of variation in the ‘entry access’ scores (r=0.63) and 44.0% of variation in the ‘consultation satisfaction’ scores (r=0.66), demonstrating acceptable construct validity. Concurrent validity was verified as each modified GPPS item was highly associated with a distinct set of related items from the OPQ. Conclusions Minor modifications are required for the English GPPS items evaluating out-of-hours care to improve comprehension by service users. A modified question set was demonstrated to comprise a valid measure of service users’ overall satisfaction with out-of-hours care received. This demonstrates the potential for the use of as few as four items in benchmarking providers and assisting services in identifying, implementing and assessing quality improvement initiatives.

Bedside application of the Neonatal Facial Coding System in pain assessment of premature neonates

Assessment of infant pain is a pressing concern, especially within the context of neonatal intensive care where infants may be exposed to prolonged and repeated pain during lengthy hospitalization. In the present study the feasibility of carrying out the complete Neonatal Facial Coding System (NFCS) in real time at bedside, specifically reliability, construct and concurrent validity, was evaluated in a tertiary level Neonatal Intensive Care Unit (NICU). Heel lance was used as a model of procedural pain, and observed with n = 40 infants at 32 weeks gestational age. Infant sleep/wake state, NFCS facial activity and specific hand movements were coded during baseline, unwrap, swab, heel lance, squeezing and recovery events. Heart rate was recorded continuously and digitally sampled using a custom designed computer system. Repeated measures analysis of variance (ANOVA) showed statistically significant differences across events for facial activity (P <0.0001) and heart rate (P <0.0001). Planned comparisons showed facial activity unchanged during baseline, swab and unwrap, then increased significantly during heel lance (P <0.0001), increased further during squeezing (P <0.003), then decreased during recovery (P <0.0001). Systematic shifts in sleep/wake state were apparent. Rise in facial activity was consistent with increased heart rate, except that facial activity more closely paralleled initiation of the invasive event. Thus facial display was more specific to tissue damage compared with heart rate. Inter-observer reliability was high. Construct validity of the NFCS at bedside was demonstrated as invasive procedures were distinguished from tactile. While bedside coding of behavior does not permit raters to be blind to events, mechanical recording of heart rate allowed for an independent source of concurrent validation for bedside application of the NFCS scale.

Characterizing changes in the excitability of corticospinal projections to proximal muscles of the upper limb

Background: There has been an explosion of interest in methods of exogenous brain stimulation that induce changes in the excitability of human cerebral cortex. The expectation is that these methods may promote recovery of function following brain injury. To assess their effects on motor output, it is typical to assess the state of corticospinal projections from primary motor cortex to muscles of the hand, via electromyographic responses to transcranial magnetic stimulation. If a range of stimulation intensities is employed, the recruitment curves (RCs) obtained can, at least for intrinsic hand muscles, be fitted by a sigmoid function.

Objective/hypothesis: To establish whether sigmoid fits provide a reliable basis upon which to characterize the input–output properties of the corticospinal pathway for muscles proximal to the hand, and to assess as an alternative the area under the (recruitment) curve (AURC).

Methods: A comparison of the reliability of these measures, using RCs obtained for muscles that are frequently the targets of rehabilitation.

Results: The AURC is an extremely reliable measure of the state of corticospinal projections to hand and forearm muscles, which has both face and concurrent validity. Construct validity is demonstrated by detection of widely distributed (across muscles) changes in corticospinal excitability induced by paired associative stimulation (PAS).

Conclusion(s): The parameters derived from sigmoid fits are unlikely to provide an adequate means to assess the effectiveness of therapeutic regimes. The AURC can be employed to characterize corticospinal projections to a range of muscles, and gauge the efficacy of longitudinal interventions in clinical rehabilitation.

An Informant Report Behavior Diary for Measuring Temper Outbursts in an Intervention Setting

Temper outbursts are associated with several psychological disorders and comprise a high priority for intervention. However, the low frequency of outbursts presents a challenge for valid measurement. In the present study an informant report behavior diary for measuring temper outbursts was developed and its validity assessed in a case series. Caregivers of 12 individuals with the neurodevelopmental disorder Prader-Willi syndrome (PWS, in which temper outbursts are common) completed a behavior diary over 4 weeks, and a structured interview. Heart rate and movement data were recorded during a sample of the days subject to diary reporting. Individuals with PWS completed self-report ratings of negative emotion experience. Behavior diaries showed high concordance with the component behaviors and duration of temper outbursts reported in structured interviews; but tended to report a lower frequency. For outbursts reported in diaries during physiological recording, heart rate was consistently elevated above a resting state baseline; and was comparable to that recorded during high physical activity. Available self-report data demonstrated correspondence with the diaries but few self-report data were produced. The present results provide critical proof of principle data supporting the concurrent validity of the ecologically valid, resource efficient diaries, which can be exploited in future research.

Computer usage and the validity of self-assessed computer competence among first-year business students

Abstract This study evaluates the reliability of self-assessment as a measure of computer competence. This evaluation is carried out in response to recent research which has employed self-reported ratings as the sole indicator of students’ computer competence. To evaluate the reliability of self-assessed computer competence, the scores achieved by students in self-assessed computer competence tests are compared with scores achieved in objective tests. The results reveal a statistically significantly over-estimation of computer competence among the students surveyed. Furthermore, reported pre-university computer experience in terms of home and school use and formal IT education does not affect this result. The findings call into question the validity of using self-assessment as a measure of computer competence. More generally, the study also provides an up-to-date picture of self-reported computer usage and IT experience among pre-university students from New Zealand and South-east Asia and contrasts these findings with those from previous research.