Response shift, recall bias and their effect on measuring change in health-related quality of life amongst older hospital patients

Background: Assessments of change in subjective patient reported outcomes such as health-related quality of life (HRQoL) are a key component of many clinical and research evaluations. However, conventional longitudinal evaluation of change may not agree with patient perceived change if patients' understanding of the subjective construct under evaluation changes over time (response shift) or if patients' have inaccurate recollection (recall bias). This study examined whether older adults' perception of change is in agreement with conventional longitudinal evaluation of change in their HRQoL over the duration of their hospital stay. It also investigated this level of agreement after adjusting patient perceived change for recall bias that patients may have experienced. Methods: A prospective longitudinal cohort design nested within a larger randomised controlled trial was implemented. 103 hospitalised older adults participated in this investigation at a tertiary hospital facility. The EQ-5D utility and Visual Analogue Scale (VAS) scores were used to evaluate HRQoL. Participants completed EQ-5D reports as soon as they were medically stable (within three days of admission) then again immediately prior to discharge. Three methods of change score calculation were used (conventional change, patient perceived change and patient perceived change adjusted for recall bias). Agreement was primarily investigated using intraclass correlation coefficients (ICC) and limits of agreement. Results: Overall 101 (98%) participants completed both admission and discharge assessments. The mean (SD) age was 73.3 (11.2). The median (IQR) length of stay was 38 (20-60) days. For agreement between conventional longitudinal change and patient perceived change: ICCs were 0.34 and 0.40 for EQ-5D utility and VAS respectively. For agreement between conventional longitudinal change and patient perceived change adjusted for recall bias: ICCs were 0.98 and 0.90 respectively. Discrepancy between conventional longitudinal change and patient perceived change was considered clinically meaningful for 84 (83.2%) of participants, after adjusting for recall bias this reduced to 8 (7.9%). Conclusions: Agreement between conventional change and patient perceived change was not strong. A large proportion of this disagreement could be attributed to recall bias. To overcome the invalidating effect of response shift (on conventional change) and recall bias (on patient perceived change) a method of adjusting patient perceived change for recall bias has been described.

Evaluation of a skin self examination attitude scale using an item response theory model approach

Introduction The Skin Self-Examination Attitude Scale (SSEAS) is a brief measure that allows for the assessment of attitudes in relation to skin self-examination. This study evaluated the psychometric properties of the SSEAS using Item Response Theory (IRT) methods in a large sample of men ≥ 50 years in Queensland, Australia. Methods A sample of 831 men (420 intervention and 411 control) completed a telephone assessment at the 13-month follow-up of a randomized-controlled trial of a video-based intervention to improve skin self-examination (SSE) behaviour. Descriptive statistics (mean, standard deviation, item–total correlations, and Cronbach’s alpha) were compiled and difficulty parameters were computed with Winsteps using the polytomous Rasch Rating Scale Model (RRSM). An item person (Wright) map of the SSEAS was examined for content coverage and item targeting. Results The SSEAS have good psychometric properties including good internal consistency (Cronbach’s alpha = 0.80), fit with the model and no evidence for differential item functioning (DIF) due to experimental trial grouping was detected. Conclusions The present study confirms the SSEA scale as a brief, useful and reliable tool for assessing attitudes towards skin self-examination in a population of men 50 years or older in Queensland, Australia. The 8-item scale shows unidimensionality, allowing levels of SSE attitude, and the item difficulties, to be ranked on a single continuous scale. In terms of clinical practice, it is very important to assess skin cancer self-examination attitude to identify people who may need a more extensive intervention to allow early detection of skin cancer.

Risk assessment of wandering behavior in mild dementia

Objective This prospective longitudinal study aims to determine the risk factors of wandering-related adverse consequences in community-dwelling persons with mild dementia. These adverse consequences include negative outcomes of wandering (falls, fractures, and injuries) and eloping behavior. Methods We recruited 143 dyads of persons with mild dementia and their caregivers from a veteran's hospital and memory clinic in Florida. Wandering-related adverse consequences were measured using the Revised Algase Wandering Scale – Community Version. Variables such as personality (Big Five Inventory), behavioral response to stress, gait, and balance (Tinetti Gait and Balance), wayfinding ability (Wayfinding Effectiveness Scale), and neurocognitive abilities (attention, cognition, memory, language/verbal skills, and executive functioning) were also measured. Bivariate and logistic regression analyses were performed to assess the predictors of these wandering-related adverse consequences. Results A total of 49% of the study participants had falls, fractures, and injuries due to wandering behavior, and 43.7% demonstrated eloping behaviors. Persistent walking (OR = 2.6) and poor gait (OR = 0.9) were significant predictors of negative outcomes of wandering, while persistent walking (OR = 13.2) and passivity (OR = 2.55) predicted eloping behavior. However, there were no correlations between wandering-related adverse consequences and participants' characteristics (age, gender, race, ethnicity, and education), health status (Charlson comorbidity index), or neurocognitive abilities. Conclusion Our results highlight the importance of identifying at-risk individuals so that effective interventions can be developed to reduce or prevent the adverse consequences of wandering.

Issues in socially desirable responding and personality research

The four studies presented in this dissertation were designed to examine the influence of socially desirable responding (SDR) on personality research outcomes. The assessment of personality relies heavily on the use of self-report questionnaires. Their validity could be threatened by people being dishonest in their self-descriptions and ascribing more desirable traits to themselves than would be warranted by their behaviour. Scales designed to detect SDR have been around for half a century, but their status continues to be debated. Paulhus (1991) Balanced Inventory of Desirable Responding (BIDR) is perhaps the most prominent of the scales developed to distinguish between those individuals who have distorted their responses and those who have not. The first two studies included in this dissertation mostly deal with the properties of the BIDR. The other two studies are less focused on SDR scales and investigate, more generally, the potential effects of SDR on two phenomena that are of central interest to the general personality discourse personality stability over time and volunteering as participants in psychological research. The data of Studies I and II showed that Paulhus BIDR scales, designed to be indicators of SDR, are not pure measures both the communion management and self-deceptive enhancement scales are, at once, measures of response bias and measures of more substantive individual differences in behaviour. The data further suggested that the communion management and self-deceptive enhancement scales of the BIDR are somewhat accurate measures of communal and agentic bias, respectively. No evidence for a suppressor model of SDR, and only weak evidence for a moderator model, was found in those studies. Concerning research on personality stability, some data in Study I suggested that SDR may add reliable and common variance to a personality questionnaire administered at two different points in time, thus artificially inflating the test-retest correlation of that questionnaire. Furthermore, Study III demonstrated that the maturity-stability hypothesis may be in part, but not entirely, a product of SDR. Study IV suggested that some of the observed personality differences between research volunteers and nonvolunteers may be due to heightened SDR of volunteers. However, those personality differences were by no means exclusively attributable to differences in SDR. In sum, the work presented in this thesis reveals some ambiguity regarding the effects of SDR on personality research, as is true of much of the previous research on SDR. Clear-cut conclusions are difficult to reach, as the data were neither fully consistent with the view that SDR can be ignored, nor with the view that SDR needs to be controlled in some way. The struggle to understand the influence of SDR on personality research continues.

Buffel grass in Queensland's semi-arid woodlands: response to local and landscape scale variables, and relationship with grass, forb and reptile species.

Buffel grass [Pennisetum ciliare (L.) Link] has been widely introduced in the Australian rangelands as a consequence of its value for productive grazing, but tends to competitively establish in non-target areas such as remnant vegetation. In this study, we examined the influence landscape-scale and local-scale variables had upon the distribution of buffel grass in remnant poplar box (Eucalyptus populnea F. Muell.) dominant woodland fragments in the Brigalow Bioregion, Queensland. Buffel grass and variables thought to influence its distribution in the region were measured at 60 sites, which were selected based on the amount of native woodland retained in the landscape and patch size. An information-theoretic modelling approach and hierarchical partitioning revealed that the most influential variable was the percent of retained vegetation within a 1-km spatial extent. From this, we identified a critical threshold of similar to 30% retained vegetation in the landscape, above which the model predicted buffel grass was not likely to occur in a woodland fragment. Other explanatory variables in the model were site based, and included litter cover and long-term rainfall. Given the paucity of information on the effect of buffel grass upon biodiversity values, we undertook exploratory analyses to determine whether buffel grass cover influenced the distribution of grass, forb and reptile species. We detected some trends; hierarchical partitioning revealed that buffel grass cover was the most important explanatory variable describing habitat preferences of four reptile species. However, establishing causal links - particularly between native grass and forb species and buffel grass - was problematic owing to possible confounding with grazing pressure. We conclude with a set of management recommendations aimed at reducing the spread of buffel grass into remnant woodlands.

Correction for Bias in Downscaling GCM Simulations for Hydrologic Impact Assessment

In a statistical downscaling model, it is important to remove the bias of General Circulations Model (GCM) outputs resulting from various assumptions about the geophysical processes. One conventional method for correcting such bias is standardisation, which is used prior to statistical downscaling to reduce systematic bias in the mean and variances of GCM predictors relative to the observations or National Centre for Environmental Prediction/ National Centre for Atmospheric Research (NCEP/NCAR) reanalysis data. A major drawback of standardisation is that it may reduce the bias in the mean and variance of the predictor variable but it is much harder to accommodate the bias in large-scale patterns of atmospheric circulation in GCMs (e.g. shifts in the dominant storm track relative to observed data) or unrealistic inter-variable relationships. While predicting hydrologic scenarios, such uncorrected bias should be taken care of; otherwise it will propagate in the computations for subsequent years. A statistical method based on equi-probability transformation is applied in this study after downscaling, to remove the bias from the predicted hydrologic variable relative to the observed hydrologic variable for a baseline period. The model is applied in prediction of monsoon stream flow of Mahanadi River in India, from GCM generated large scale climatological data.

An item response analysis of the motor and behavioral subscales of the unified Huntington's disease rating scale in huntington disease gene expansion carriers

Although the Unified Huntington's Disease Rating Scale (UHDRS) is widely used in the assessment of Huntington disease (HD), the ability of individual items to discriminate individual differences in motor or behavioral manifestations has not been extensively studied in HD gene expansion carriers without a motor-defined clinical diagnosis (ie, prodromal-HD or prHD). To elucidate the relationship between scores on individual motor and behavioral UHDRS items and total score for each subscale, a nonparametric item response analysis was performed on retrospective data from 2 multicenter longitudinal studies. Motor and behavioral assessments were supplied for 737 prHD individuals with data from 2114 visits (PREDICT-HD) and 686 HD individuals with data from 1482 visits (REGISTRY). Option characteristic curves were generated for UHDRS subscale items in relation to their subscale score. In prHD, overall severity of motor signs was low, and participants had scores of 2 or above on very few items. In HD, motor items that assessed ocular pursuit, saccade initiation, finger tapping, tandem walking, and to a lesser extent, saccade velocity, dysarthria, tongue protrusion, pronation/supination, Luria, bradykinesia, choreas, gait, and balance on the retropulsion test were found to discriminate individual differences across a broad range of motor severity. In prHD, depressed mood, anxiety, and irritable behavior demonstrated good discriminative properties. In HD, depressed mood demonstrated a good relationship with the overall behavioral score. These data suggest that at least some UHDRS items appear to have utility across a broad range of severity, although many items demonstrate problematic features.

Assessment of inter-examiner agreement and variability in the manual classification of auditory brainstem response

Abstract Background: The analysis of the Auditory Brainstem Response (ABR) is of fundamental importance to the investigation of the auditory system behaviour, though its interpretation has a subjective nature because of the manual process employed in its study and the clinical experience required for its analysis. When analysing the ABR, clinicians are often interested in the identification of ABR signal components referred to as Jewett waves. In particular, the detection and study of the time when these waves occur (i.e., the wave latency) is a practical tool for the diagnosis of disorders affecting the auditory system. Significant differences in inter-examiner results may lead to completely distinct clinical interpretations of the state of the auditory system. In this context, the aim of this research was to evaluate the inter-examiner agreement and variability in the manual classification of ABR. Methods: A total of 160 ABR data samples were collected, for four different stimulus intensity (80dBHL, 60dBHL, 40dBHL and 20dBHL), from 10 normal-hearing subjects (5 men and 5 women, from 20 to 52 years). Four examiners with expertise in the manual classification of ABR components participated in the study. The Bland-Altman statistical method was employed for the assessment of inter-examiner agreement and variability. The mean, standard deviation and error for the bias, which is the difference between examiners’ annotations, were estimated for each pair of examiners. Scatter plots and histograms were employed for data visualization and analysis. Results: In most comparisons the differences between examiner’s annotations were below 0.1 ms, which is clinically acceptable. In four cases, it was found a large error and standard deviation (>0.1 ms) that indicate the presence of outliers and thus, discrepancies between examiners. Conclusions: Our results quantify the inter-examiner agreement and variability of the manual analysis of ABR data, and they also allows for the determination of different patterns of manual ABR analysis.

Precipitation diurnal cycle and summer climatology assessment over South America: An evaluation of Regional Climate Model version 3 simulations

Regional Climate Model version 3 (RegCM3) simulations of 17 summers (1988-2004) over part of South America south of 5 degrees S were evaluated to identify model systematic errors. Model results were compared to different rainfall data sets (Climate Research Unit (CRU), Climate Prediction Center (CPC), Global Precipitation Climatology Project (GPCP), and National Centers for Environmental Prediction (NCEP) reanalysis), including the five summers mean (1998-2002) precipitation diurnal cycle observed by the Tropical Rainfall Measuring Mission (TRMM)-Precipitation Radar (PR). In spite of regional differences, the RegCM3 simulates the main observed aspects of summer climatology associated with the precipitation (northwest-southeast band of South Atlantic Convergence Zone (SACZ)) and air temperature (warmer air in the central part of the continent and colder in eastern Brazil and the Andes Mountains). At a regional scale, the main RegCM3 failures are the underestimation of the precipitation in the northern branch of the SACZ and some unrealistic intense precipitation around the Andes Mountains. However, the RegCM3 seasonal precipitation is closer to the fine-scale analyses (CPC, CRU, and TRMM-PR) than is the NCEP reanalysis, which presents an incorrect north-south orientation of SACZ and an overestimation of its intensity. The precipitation diurnal cycle observed by TRMM-PR shows pronounced contrasts between Tropics and Extratropics and land and ocean, where most of these features are simulated by RegCM3. The major similarities between the simulation and observation, especially the diurnal cycle phase, are found over the continental tropical and subtropical SACZ regions, which present afternoon maximum (1500-1800 UTC) and morning minimum (0900-1200 UTC). More specifically, over the core of SACZ, the phase and amplitude of the simulated precipitation diurnal cycle are very close to the TRMM-PR observations. Although there are amplitude differences, the RegCM3 simulates the observed nighttime rainfall in the eastern Andes Mountains, over the Atlantic Ocean, and also over northern Argentina. The main simulation deficiencies are found in the Atlantic Ocean and near the Andes Mountains. Over the Atlantic Ocean the convective scheme is not triggered; thus the rainfall arises from the grid-scale scheme and therefore differs from the TRMM-PR. Near the Andes, intense (nighttime and daytime) simulated precipitation could be a response of an incorrect circulation and topographic uplift. Finally, it is important to note that unlike most reported bias of global models, RegCM3 does not trigger the moist convection just after sunrise over the southern part of the Amazon.

The Neuropsychiatric Inventory-Clinician rating scale (NPI-C): Reliability and validity of a revised assessment of neuropsychiatric symptoms in dementia

Background: Neuropsychiatric symptoms (NPS) affect almost all patients with dementia and are a major focus of study and treatment. Accurate assessment of NPS through valid, sensitive and reliable measures is crucial. Although current NPS measures have many strengths, they also have some limitations (e.g. acquisition of data is limited to informants or caregivers as respondents, limited depth of items specific to moderate dementia). Therefore, we developed a revised version of the NPI, known as the NPI-C. The NPI-C includes expanded domains and items, and a clinician-rating methodology. This study evaluated the reliability and convergent validity of the NPI-C at ten international sites (seven languages). Methods: Face validity for 78 new items was obtained through a Delphi panel. A total of 128 dyads (caregivers/patients) from three severity categories of dementia (mild = 58, moderate = 49, severe = 21) were interviewed separately by two trained raters using two rating methods: the original NPI interview and a clinician-rated method. Rater 1 also administered four additional, established measures: the Apathy Evaluation Scale, the Brief Psychiatric Rating Scale, the Cohen-Mansfield Agitation Index, and the Cornell Scale for Depression in Dementia. Intraclass correlations were used to determine inter-rater reliability. Pearson correlations between the four relevant NPI-C domains and their corresponding outside measures were used for convergent validity. Results: Inter-rater reliability was strong for most items. Convergent validity was moderate (apathy and agitation) to strong (hallucinations and delusions; agitation and aberrant vocalization; and depression) for clinician ratings in NPI-C domains. Conclusion: Overall, the NPI-C shows promise as a versatile tool which can accurately measure NPS and which uses a uniform scale system to facilitate data comparisons across studies. Copyright © 2010 International Psychogeriatric Association.

Development of the Davos Assessment of Cognitive Biases Scale (DACOBS)

Objective: Cognitive problems and biases play an important role in the development and continuation of psychosis. A self-report measure of these deficits and processes was developed (Davos Assessment of Cognitive Biases Scale: DACOBS) and is evaluated in this study. Methods: An item pool made by international experts was used to develop a self-report scale on a sample of 138 schizophrenia spectrum patients. Another sample of 71 patients was recruited to validate the subscales. A group of 186 normal control subjects was recruited to establish norms and examine discriminative validity. Results: Factor analyses resulted in seven factors, each with six items (jumping to conclusions, belief inflexibility bias, attention for threat bias, external attribution bias, social cognition problems, subjective cognitive problems and safety behavior). All factors independently explained the variance (eigenvalues > 2) and total explained variance was 45%. Reliability was good (Cronbach's alpha = .90; split-half reliability = .92; test–retest reliability = .86). The DACOBS discriminates between schizophrenia spectrum patients and normal control subjects. Validity was affirmed for five of seven subscales. The scale ‘Subjective Cognitive problems’ was not associated with objective cognitive functioning and ‘Social cognition problems’ was not associated with the Hinting task, but with the scale measuring ideas of social reference. Conclusions: The DACOBS scale, with seven independent subscales, is reliable and valid for use in clinical practice and research.

The Spanish version of the Prenatal Breast-feeding Self-efficacy Scale: Reliability and validity assessment

Background: Only a minority of infants are exclusively breastfed for the recommended 6 months postpartum. Breast-feeding self-efficacy is a mother's confidence in her ability to breastfeed and is predictive of breastfeeding behaviors. The Prenatal Breast-feeding Self-efficacy Scale (PBSES) was developed among English-speaking mothers to measure breastfeeding self-efficacy before delivery. Objectives: To translate the PBSES into Spanish and assess its psychometric properties. Design: Reliability and validity assessment. Setting: A public hospital in Yecla, Spain. Participants: A convenience sample of 234 pregnant women in their third trimester of pregnancy. Methods: The PBSES was translated into Spanish using forward and back translation. A battery of self-administered questionnaires was completed by participants, including a questionnaire on sociodemographic variables, breastfeeding experience and intention, as well as the Spanish version of the PBSES. Also, data on exclusive breastfeeding at discharge were collected from hospital database. Dimensional structure, internal consistency and construct validity of the Spanish version of PBSES were assessed. Results: Confirmatory factor analysis suggested the presence of one construct, self-efficacy, with four dimensions or latent variables. Cronbach's alpha coefficient for internal consistency was 0.91. Response patterns based on decision to breastfeed during pregnancy provided evidence of construct validity. In addition, the scores of the Spanish version of the PBSES significantly predicted exclusive breastfeeding at discharge. Conclusions: The Spanish version of PBSES shows evidences of reliability, and contrasting group and predictive validity. Confirmatory factor analysis indicated marginal fit and further studies are needed to provide new evidence on the structure of the scale. The Spanish version of the PBSES can be considered a reliable measure and shows validity evidences.

Investigation of psychological and neuropsychological factors associated with clinical outcome following a group rehabilitation programme

The present study investigated neuropsychological and psychological factors associated with successful treatment outcome following a group intervention for individuals with acquired brain injury (ABI). Participants were classified into two groups (Clinically Improved and Not Improved) based upon the findings of a previous study (Ownsworth, McFarland, & Young, 2000a). A discriminant analysis was used to predict group membership on three outcome measures (Awareness and Strategy Behaviour indices of the Self-Regulation Skills Interview and the Psychosocial Dimension of the Sickness Impact Profile) between pre-assessment and post-assessment, and between pre-assessment and 6 months follow-up. Neuropsychological factors involved measures of executive functioning and psychological factors were assessed using measures of personality-related denial and coping-related denial. Overall, the results indicated that individuals with impaired executive functioning were most likely to be classified as Clinically Improved on measures of awareness, strategy behaviour and psychosocial functioning. Individuals who deny or minimise their ABI symptoms were less likely to improve their psychosocial functioning following the group intervention. Future research needs to evaluate interventions for enhancing self-regulation skills and improving psychosocial functioning for individuals who employ denial as a main strategy for coping following ABI.

The appetitive motivation scale and other BAS measures in the prediction of Approach and Active Avoidance

The Appetitive Motivation Scale (Jackson & Smillie, 2004) is a new trait conceptualisation of Gray's (I 970 199 1) Behavioural Activation System. In this experiment we explore relationships that the Appetitive Motivation Scale and other measures of Gray's model have with Approach and Active Avoidance responses. Using a sample of 144 undergraduate students, both Appetitive Motivation and Sensitivity to Reward (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire, SPSRQ; Torrubia, Avila, Molto, & Ceseras, 2001), were found to be significant predictors of Approach and Active Avoidance response latency. This confirms previous experimental validations of the SPSRQ (e.g., Avila, 2001) and provides the first experimental evidence for the validity of the Appetitive Motivation scale. Consistent with interactive views of Gray's model (e.g., Corr, 2001), high SPSRQ Sensitivity to Punishment diminished the relationship between Sensitivity to Reward and our BAS criteria. Measures of BIS did not however interact in this way with the appetitive motivation scale. A surprising result was the failure for any of Carver and White's (1994) BAS scales to correlate with RST criteria. Implications of these findings and potential future directions are discussed. (C) 2004 Elsevier Ltd. All rights reserved.