Improving self-report measures of speeding

There is continuing debate regarding the psychometric properties of self-report measures of behaviour, particularly in road safety research. Practical considerations often preclude the use of objective assessments, leading to reliance on self-report measures. Acknowledging that such measures are likely to remain commonly used, this pilot project sought not to argue whether self-report measures should continue to be used, but to explore factors associated with how individuals respond to self-reported speeding measures. This paper reports preliminary findings from a qualitative study (focus groups and in-depth interviews) conducted with licensed drivers to explore the operational utility of self-reported speeding behaviour measures. Drawing upon concepts from the Theory of Planned Behaviour (TPB; Ajzen, 1991) and Agency Theory (Bandura, 2001), we identified four dimensions of self-reported speeding: including timeframe, speed zone, degree over the speed limit and, overall frequency of the behaviour, and examined participants’ perceptions of the operational utility of these factors. Issues related to comprehensibility, perceived accuracy, response format and layout were also explored. Results indicated that: heterogeneity in the timeframe of behavioural reflections suggests a need to provide a set timeframe for participants to consider when thinking about their previous speeding behaviour; response categories and formats should be carefully considered to ensure the most accurate representations of the frequency and degree of speeding are captured; the need to clearly articulate “low-level” speeding on self-report measures; and, that self-reports of speeding behaviour are typically context-irrelevant unless stipulated in the question. Limitations and directions for further research are discussed.

Comparison of 3 accelerometer data reduction approaches, step counts, and 2 self-report measures for estimating physical activity in free-living adults

Background Accelerometers have become one of the most common methods of measuring physical activity (PA). Thus, validity of accelerometer data reduction approaches remains an important research area. Yet, few studies directly compare data reduction approaches and other PA measures in free-living samples. Objective To compare PA estimates provided by 3 accelerometer data reduction approaches, steps, and 2 self-reported estimates: Crouter's 2-regression model, Crouter's refined 2-regression model, the weighted cut-point method adopted in the National Health and Nutrition Examination Survey (NHANES; 2003-2004 and 2005-2006 cycles), steps, IPAQ, and 7-day PA recall. Methods A worksite sample (N = 87) completed online-surveys and wore ActiGraph GT1M accelerometers and pedometers (SW-200) during waking hours for 7 consecutive days. Daily time spent in sedentary, light, moderate, and vigorous intensity activity and percentage of participants meeting PA recommendations were calculated and compared. Results Crouter's 2-regression (161.8 +/- 52.3 minutes/day) and refined 2-regression (137.6 +/- 40.3 minutes/day) models provided significantly higher estimates of moderate and vigorous PA and proportions of those meeting PA recommendations (91% and 92%, respectively) as compared with the NHANES weighted cut-point method (39.5 +/- 20.2 minutes/day, 18%). Differences between other measures were also significant. Conclusions When comparing 3 accelerometer cut-point methods, steps, and self-report measures, estimates of PA participation vary substantially.

Modeling continuous self-report measures of perceived emotion using generalized additive mixed models

Emotion research has long been dominated by the “standard method” of displaying posed or acted static images of facial expressions of emotion. While this method has been useful it is unable to investigate the dynamic nature of emotion expression. Although continuous self-report traces have enabled the measurement of dynamic expressions of emotion, a consensus has not been reached on the correct statistical techniques that permit inferences to be made with such measures. We propose Generalized Additive Models and Generalized Additive Mixed Models as techniques that can account for the dynamic nature of such continuous measures. These models allow us to hold constant shared components of responses that are due to perceived emotion across time, while enabling inference concerning linear differences between groups. The mixed model GAMM approach is preferred as it can account for autocorrelation in time series data and allows emotion decoding participants to be modelled as random effects. To increase confidence in linear differences we assess the methods that address interactions between categorical variables and dynamic changes over time. In addition we provide comments on the use of Generalized Additive Models to assess the effect size of shared perceived emotion and discuss sample sizes. Finally we address additional uses, the inference of feature detection, continuous variable interactions, and measurement of ambiguity.

The assessment of mindfulness with self-report measures: existing scales and open issues

During recent years, mindfulness-based approaches have been gaining relevance for treatment in clinical populations. Correspondingly, the empirical study of mindfulness has steadily grown; thus, the availability of valid measures of the construct is critically important. This paper gives an overview of the current status in the field of self-report assessment of mindfulness. All eight currently available and validated mindfulness scales (for adults) are evaluated, with a particular focus on their virtues and limitations and on differences among them. It will be argued that none of these scales may be a fully adequate measure of mindfulness, as each of them offers unique advantages but also disadvantages. In particular, none of them seems to provide a comprehensive assessment of all aspects of mindfulness in samples from the general population. Moreover, some scales may be particularly indicated in investigations focusing on specific populations such as clinical samples (Cognitive and Affective Mindfulness Scale, Southampton Mindfulness Questionnaire) or meditators (Freiburg Mindfulness Inventory). Three main open issues are discussed: (1) the coverage of aspects of mindfulness in questionnaires; (2) the nature of the relationships between these aspects; and (3) the validity of self-report measures of mindfulness. These issues should be considered in future developments in the self-report assessment of mindfulness.

Young drivers’ responses to anti-speeding advertisements: Comparison of self-report and objective measures of persuasive processing and outcomes

Objective Self-report measures are typically used to assess the effectiveness of road safety advertisements. However, psychophysiological measures of persuasive processing (i.e., skin conductance response [SCR]) and objective driving measures of persuasive outcomes (i.e., in-vehicle GPS devices) may provide further insights into the effectiveness of these advertisements. This study aimed to explore the persuasive processing and outcomes of two anti-speeding advertisements by incorporating both self-report and objective measures of speeding behaviour. In addition, this study aimed to compare the findings derived from these different measurement approaches. Methods Young drivers (N = 20, Mage = 21.01 years) viewed either a positive or negative emotion-based anti-speeding television advertisement. Whilst viewing the advertisement, SCR activity was measured to assess ad-evoked arousal responses. The RoadScout® GPS device was then installed into participants’ vehicles for one week to measure on-road speed-related driving behaviour. Self-report measures assessed persuasive processing (emotional and arousal responses) and actual driving behaviour. Results There was general correspondence between the self-report measures of arousal and the SCR and between the self-report measure of actual driving behaviour and the objective driving data (as assessed via the GPS devices). Conclusions This study provides insights into how psychophysiological and GPS devices could be used as objective measures in conjunction with self-report measures to further understand the persuasive processes and outcomes of emotion-based anti-speeding advertisements.

Enquiring about traumatic experiences in bipolar disorder: A case note and self- report comparison

Objectives: This study examined: (i) the prevalence of lifetime trauma, childhood trauma and trauma related to civil unrest in a Bipolar Disorder sample, and (ii) the agreement between rates of disclosure of trauma in case notes and self-report questionnaires.

Methods: The case notes of sixty participants, recruited from a geographically well-defined mental health service in Northern Ireland, were examined for reports of experiences of lifetime, childhood and traumatic events related to civil conflict. The participants also completed self-report measures of trauma.

Results: Considerable differences were found between the prevalence of trauma as measured by self-report questionnaires and case notes reports. The prevalence of lifetime trauma as measured by the Trauma History Questionnaire was 61.7% (compared to case notes prevalence of 33.3%). The prevalence of moderate and severe levels of childhood trauma as measured by the Childhood Trauma Questionnaire was 65% (case notes 21.7%). Rates of trauma related to civil unrest were 35% (case notes 3.3%). Poor levels of agreement were found between all self-report trauma measures and case notes reports. Agreement on two categories of trauma (childhood emotional neglect and childhood physical neglect) reached statistical significance but kappa scores suggest this agreement was poor (kappa = .14. p<.05; kappa = .127, p<.05). © 2011 Elsevier B.V. All rights reserved.

Conclusions: It is probable that the increased rate of trauma disclosed in the self-report questionnaire arises because clinicians during initial assessment and subsequent treatment do not consistently enquire about trauma. The need for staff training is discussed. (C) 2011 Elsevier B.V. All rights reserved.

Enquiring about traumatic experiences in psychosis: A comparison of case notes and self-report questionnaires

Purpose: Studies have found an association between a history of trauma and the presence of psychotic symptoms. Despite the research evidence it appears to be the case that many clinicians are not routinely asking about traumatic experiences. This study aims to ascertain the level of agreement between rates of self-reported trauma and that which is recorded in case notes.

Methods: The study population was drawn from all individuals with a confirmed diagnosis of psychosis, residing within a defined catchment area. Rates of childhood trauma, lifetime trauma and trauma related to the Troubles in Northern Ireland recorded in participants’ case notes were compared to their responses on self-report questionnaires: THQ, CTQ and TREQ.

Results: Relatively high levels of trauma were reported by participants on the self-report measures that were administered. The rates of trauma recorded in case note records were similar to that found in other studies. Also in line with other research were poor levels of agreement between self-report and case note data.

Conclusion: High levels of lifetime, childhood and trauma related to the Troubles in Northern Ireland were found when the individuals in the sample were directly assessed for the purposes of this study. In contrast much lower rates were recorded in patient notes on routine clinical assessment. The results suggest that clinicians do not routinely enquire about trauma histories with this population and as a result, case notes underestimate trauma prevalence.

Do Things Change in Therapy That Are Not Measured By Self-report Instruments?

This study investigates a new way of assessing change in psychotherapy, with the goal of decreasing the schism in the field of psychology between research and clinical practice. Change in psychotherapy was assessed in clients presenting with depressive symptoms who were seeking therapy at the Professional Psychology Center (PPC) at the University of Denver. Prior to beginning treatment, the subjects completed the Beck Depression Inventory- II (BDI-II) and the Symptom Checklist-90-R (SCL-90), and were also assessed by independent clinicians using the Shedler-Westen Assessment Procedure II (SWAP-II). Six to nine months later, after completing at least 12 psychotherapy sessions (range 12-21 sessions), the assessment procedure was repeated.There were no significant differences pre- to post-treatment on any measure. However, two subjects in the sample appeared to benefit from treatment, as assessed by both the self-report measures and the SWAP-II. The findings for these two subjects suggest that the SWAP-II can provide a greater depth of understanding about what can change in therapy than self-report measures alone. Possible reasons for the lack of treatment effects in the larger sample are discussed.

Self-, parent-report and interview measures of obsessive-compulsive disorder in children and adolescents

Self-report measures of obsessive-compulsive disorder (OCD) in children and adolescents are needed for practical evaluation of severity and treatment response. We compared the self- and parent-report Obsessional Compulsive Inventory Revised (CHOCI-R) to the interview-based Child Yale-Brown Obsessive-Compulsive Scale (CY-BOCS) in a clinical sample of 285 children and adolescents with OCD. Classical test theory and item-response theory were applied to compare the instruments. The self- and parent-report CHOCI-R had good internal consistency and were strongly related to each other. The self- and parent-report CHOCI-R severity scores correlated with the CY-BOCS (Pearson's r 0.55 and 0.45 respectively). The CY-BOCS discriminated better at the severe end of the spectrum. The CHOCI-R provided better discrimination in the mild to moderate range. The time-efficient self- and parent-report alternatives will enable routine measurement of OCD severity in clinical practice. Estimates of equivalent summed scores are provided to facilitate comparison. (c) 2007 Elsevier Ltd. All rights reserved.

The Child Behavior Checklist and Youth Self-Report in adolescents with epilepsy : testing measurement invariance of the Attention and Thought Problems subscales

The objective of this study was to test for the measurement invariance of the Attention and Thought Problems subscales of the Child Behavior Checklist (CBCL) and Youth Self-Report (YSR) in a population-based sample of adolescents with and without epilepsy. Data were obtained from the 14-year follow-up of the Mater University Study of Pregnancy in which 33 adolescents with epilepsy and 1068 healthy controls were included for analysis. Confirmatory factor analysis was used to test for measurement invariance between adolescents with and without epilepsy. Structural equation modeling was used to test for group differences in attention and thought problems as measured with the CBCL and YSR. Measurement invariance was demonstrated for the original CBCL Attention Problems and YSR Thought Problems. After the removal of ambiguous items (“confused” and “daydreams”),measurement invariance was established for the YSR Attention Problems. The original and reduced CBCL Thought Problems were noninvariant. Adolescents with epilepsy had significantly more symptoms of behavioral problems on the CBCL Attention Problems, β = 0.51, p = 0.002, compared with healthy controls. In contrast, no significant differences were found for the YSR Attention and Thought Problems, β = −0.11, p = 0.417 and β = −0.20, p = 0.116, respectively. In this population-based sample of adolescents with epilepsy, the CBCL Attention Problems and YSR Thought Problems appear to be valid measures of behavioral problems, whereas the YSR Attention Problems was valid only after the removal of ambiguous items. Replication of these findings in clinical samples of adolescents with epilepsy that overcome the limitations of the current study is warranted.

Predicting crashes using traffic offences. A meta-analysis that examines potential bias between self-report and archival data

Background Traffic offences have been considered an important predictor of crash involvement, and have often been used as a proxy safety variable for crashes. However the association between crashes and offences has never been meta-analysed and the population effect size never established. Research is yet to determine the extent to which this relationship may be spuriously inflated through systematic measurement error, with obvious implications for researchers endeavouring to accurately identify salient factors predictive of crashes. Methodology and Principal Findings Studies yielding a correlation between crashes and traffic offences were collated and a meta-analysis of 144 effects drawn from 99 road safety studies conducted. Potential impact of factors such as age, time period, crash and offence rates, crash severity and data type, sourced from either self-report surveys or archival records, were considered and discussed. After weighting for sample size, an average correlation of r = .18 was observed over the mean time period of 3.2 years. Evidence emerged suggesting the strength of this correlation is decreasing over time. Stronger correlations between crashes and offences were generally found in studies involving younger drivers. Consistent with common method variance effects, a within country analysis found stronger effect sizes in self-reported data even controlling for crash mean. Significance The effectiveness of traffic offences as a proxy for crashes may be limited. Inclusion of elements such as independently validated crash and offence histories or accurate measures of exposure to the road would facilitate a better understanding of the factors that influence crash involvement.

Physical activity in US Blacks: a systematic review and critical examination of self-report instruments.

BACKGROUND: Physical activity self-report instruments in the US have largely been developed for and validated in White samples. Despite calls to validate existing instruments in more diverse samples, relatively few instruments have been validated in US Blacks. Emerging evidence suggests that these instruments may have differential validity in Black populations. PURPOSE: This report reviews and evaluates the validity and reliability of self-reported measures of physical activity in Blacks and makes recommendations for future directions. METHODS: A systematic literature review was conducted to identify published reports with construct or criterion validity evaluated in samples that included Blacks. Studies that reported results separately for Blacks were examined. RESULTS: The review identified 10 instruments validated in nine manuscripts. Criterion validity correlations tended to be low to moderate. No study has compared the validity of multiple instruments in a single sample of Blacks. CONCLUSION: There is a need for efforts validating self-report physical activity instruments in Blacks, particularly those evaluating the relative validity of instruments in a single sample.

Measuring the psychosocial characteristics of family caregivers of palliative care patients:psychometric properties of nine self-report instruments

Researchers and clinicians have experienced substantial difficulties locating measures that are suitable for use within palliative care settings. This article details the psychometric properties of nine instruments designed to assess the following psychosocial characteristics of family caregivers: competence, mastery, self-efficacy, burden, optimism, preparedness, social support, rewards, and mutuality. Results are based on the responses of 106 primary family caregivers caring for relatives dying of cancer. Principal components extraction with varimax rotation was used to explore the underlying structure of each measure. Following the exclusion of complex variables, suggested components for most measures comprised relatively homogenous items, which were good to excellent measures of each component. Some components comprised only two items; however, Cronbach's alphas typically indicated moderate to high levels of internal consistency. Overall, the results of this study suggest that most of the measures analyzed, excepting the mastery and mutuality scales, can be recommended to examine the family caregiver experience and test supportive interventions.