Confirmatory factor analysis of the adolescent self-report strengths and difficulties questionnaire

The Strengths and Difficulties Questionnaire (SDQ) is a widely used 25-item screening test for emotional and behavioral problems in children and adolescents. This study attempted to critically examine the factor structure of the adolescent self-report version. As part of an ongoing longitudinal cohort study, a total of 3,753 pupils completed the SDQ when aged 12. Both three- and five-factor exploratory factor analysis models were estimated. A number of deviations from the hypothesized SDQ structure were observed, including a lack of unidimensionality within particular subscales, cross-loadings, and items failing to load on any factor. Model fit of the confirmatory factor analysis model was modest, providing limited support for the hypothesized five-component structure. The analyses suggested a number of weaknesses within the component structure of the self-report SDQ, particularly in relation to the reverse-coded items.

Do smokers with chronic obstructive pulmonary disease report their smoking status reliably?:A comparison of self-report and bio-chemical validation

Chronic obstructive pulmonary disease (COPD) is predominantly caused by cigarette smoking and is considered a worldwide preventable chronic illness. Smoking cessation is considered the primary intervention for disease management and nurses should play a major role in assisting patients to stop smoking. Currently there is a lack of professional consensus on how cessation interventions should be evaluated. The vast array of biochemical markers reported in the literature can be confusing and can make the comparisons of results difficult.

Agreement between self-report and medical records on signs and symptoms of respiratory illness

Background: Information on patient symptoms can be obtained by patient self-report or medical records review. Both methods have limitations. Aims: To assess the agreement between self-report and documentation in the medical records of signs/symptoms of respiratory illness (fever, cough, runny nose, sore throat, headache, sinus problems, muscle aches, fatigue, earache, and chills). Methods: Respondents were 176 research participants in the Hutterite Influenza Prevention Study during the 2008-2009 influenza season with information about the presence or absence of signs/symptoms from both self-report and primary care medical records. Results: Compared with medical records, lower proportions of self-reported fever, sore throat, earache, cough, and sinus problems were found. Total agreements between self-report and medical report of symptoms ranged from 61% (for sore throat) to 88% (for muscle aches and earache), with kappa estimates varying from 0.05 (for chills) to 0.41 (for cough) and 0.51 (for earache). Negative agreement was considerably higher (from 68% for sore throat to 93% for muscle aches and earache) than positive agreement (from 13% for chills to 58% for earache) for each symptom except cough where positive agreement (77%) was higher than negative agreement (64%). Agreements varied by age group. We found better agreement for earache (kappa=0.62) and lower agreements for headache, sinus problems, muscle aches, fatigue, and chills in older children (aged =5 years) and adults. Conclusions: Agreements were variable depending on the specific symptom. Contrary to research in other patient populations which suggests that clinicians report fewer symptoms than patients, we found that the medical record captured more symptoms than selfreport. Symptom agreement and disagreement may be affected by the perspectives of the person experiencing them, the observer, the symptoms themselves, measurement error, the setting in which the symptoms were observed and recorded, and the broader community and cultural context of patients. © 2012 Primary Care Respiratory Society UK. All rights reserved.

A comparison of self-report and health care provider data to assess surveillance definitions of influenza-like illness in outpatients

Objective: Several surveillance definitions of influenza-like illness (ILI) have been proposed, based on the presence of symptoms. Symptom data can be obtained from patients, medical records, or both. Past research has found that agreements between health record data and self-report are variable depending on the specific symptom. Therefore, we aimed to explore the implications of using data on influenza symptoms extracted from medical records, similar data collected prospectively from outpatients, and the combined data from both sources as predictors of laboratory-confirmed influenza. Methods: Using data from the Hutterite Influenza Prevention Study, we calculated: 1) the sensitivity, specificity and predictive values of individual symptoms within surveillance definitions; 2) how frequently surveillance definitions correlated to laboratory-confirmed influenza; and 3) the predictive value of surveillance definitions. Results: Of the 176 participants with reports from participants and medical records, 142 (81%) were tested for influenza and 37 (26%) were PCR positive for influenza. Fever (alone) and fever combined with cough and/or sore throat were highly correlated with being PCR positive for influenza for all data sources. ILI surveillance definitions, based on symptom data from medical records only or from both medical records and self-report, were better predictors of laboratory-confirmed influenza with higher odds ratios and positive predictive values. Discussion: The choice of data source to determine ILI will depend on the patient population, outcome of interest, availability of data source, and use for clinical decision making, research, or surveillance. © Canadian Public Health Association, 2012.

Enquiring about traumatic experiences in bipolar disorder: A case note and self- report comparison

Objectives: This study examined: (i) the prevalence of lifetime trauma, childhood trauma and trauma related to civil unrest in a Bipolar Disorder sample, and (ii) the agreement between rates of disclosure of trauma in case notes and self-report questionnaires.

Methods: The case notes of sixty participants, recruited from a geographically well-defined mental health service in Northern Ireland, were examined for reports of experiences of lifetime, childhood and traumatic events related to civil conflict. The participants also completed self-report measures of trauma.

Results: Considerable differences were found between the prevalence of trauma as measured by self-report questionnaires and case notes reports. The prevalence of lifetime trauma as measured by the Trauma History Questionnaire was 61.7% (compared to case notes prevalence of 33.3%). The prevalence of moderate and severe levels of childhood trauma as measured by the Childhood Trauma Questionnaire was 65% (case notes 21.7%). Rates of trauma related to civil unrest were 35% (case notes 3.3%). Poor levels of agreement were found between all self-report trauma measures and case notes reports. Agreement on two categories of trauma (childhood emotional neglect and childhood physical neglect) reached statistical significance but kappa scores suggest this agreement was poor (kappa = .14. p<.05; kappa = .127, p<.05). © 2011 Elsevier B.V. All rights reserved.

Conclusions: It is probable that the increased rate of trauma disclosed in the self-report questionnaire arises because clinicians during initial assessment and subsequent treatment do not consistently enquire about trauma. The need for staff training is discussed. (C) 2011 Elsevier B.V. All rights reserved.

Measuring the psychosocial characteristics of family caregivers of palliative care patients:psychometric properties of nine self-report instruments

Researchers and clinicians have experienced substantial difficulties locating measures that are suitable for use within palliative care settings. This article details the psychometric properties of nine instruments designed to assess the following psychosocial characteristics of family caregivers: competence, mastery, self-efficacy, burden, optimism, preparedness, social support, rewards, and mutuality. Results are based on the responses of 106 primary family caregivers caring for relatives dying of cancer. Principal components extraction with varimax rotation was used to explore the underlying structure of each measure. Following the exclusion of complex variables, suggested components for most measures comprised relatively homogenous items, which were good to excellent measures of each component. Some components comprised only two items; however, Cronbach's alphas typically indicated moderate to high levels of internal consistency. Overall, the results of this study suggest that most of the measures analyzed, excepting the mastery and mutuality scales, can be recommended to examine the family caregiver experience and test supportive interventions.

Modeling continuous self-report measures of perceived emotion using generalized additive mixed models

Emotion research has long been dominated by the “standard method” of displaying posed or acted static images of facial expressions of emotion. While this method has been useful it is unable to investigate the dynamic nature of emotion expression. Although continuous self-report traces have enabled the measurement of dynamic expressions of emotion, a consensus has not been reached on the correct statistical techniques that permit inferences to be made with such measures. We propose Generalized Additive Models and Generalized Additive Mixed Models as techniques that can account for the dynamic nature of such continuous measures. These models allow us to hold constant shared components of responses that are due to perceived emotion across time, while enabling inference concerning linear differences between groups. The mixed model GAMM approach is preferred as it can account for autocorrelation in time series data and allows emotion decoding participants to be modelled as random effects. To increase confidence in linear differences we assess the methods that address interactions between categorical variables and dynamic changes over time. In addition we provide comments on the use of Generalized Additive Models to assess the effect size of shared perceived emotion and discuss sample sizes. Finally we address additional uses, the inference of feature detection, continuous variable interactions, and measurement of ambiguity.

An analysis of the masking of speech by competing speech using self-report data (L)

Many of the items in the “Speech, Spatial, and Qualities of Hearing” scale questionnaire [S. Gatehouse and W. Noble, Int. J. Audiol.43, 85–99 (2004)] are concerned with speech understanding in a variety of backgrounds, both speech and nonspeech. To study if this self-report data reflected informational masking, previously collected data on 414 people were analyzed. The lowest scores (greatest difficulties) were found for the two items in which there were two speech targets, with successively higher scores for competing speech (six items), energetic masking (one item), and no masking (three items). The results suggest significant masking by competing speech in everyday listening situations.

Enquiring about traumatic experiences in psychosis: A comparison of case notes and self-report questionnaires

Purpose: Studies have found an association between a history of trauma and the presence of psychotic symptoms. Despite the research evidence it appears to be the case that many clinicians are not routinely asking about traumatic experiences. This study aims to ascertain the level of agreement between rates of self-reported trauma and that which is recorded in case notes.

Methods: The study population was drawn from all individuals with a confirmed diagnosis of psychosis, residing within a defined catchment area. Rates of childhood trauma, lifetime trauma and trauma related to the Troubles in Northern Ireland recorded in participants’ case notes were compared to their responses on self-report questionnaires: THQ, CTQ and TREQ.

Results: Relatively high levels of trauma were reported by participants on the self-report measures that were administered. The rates of trauma recorded in case note records were similar to that found in other studies. Also in line with other research were poor levels of agreement between self-report and case note data.

Conclusion: High levels of lifetime, childhood and trauma related to the Troubles in Northern Ireland were found when the individuals in the sample were directly assessed for the purposes of this study. In contrast much lower rates were recorded in patient notes on routine clinical assessment. The results suggest that clinicians do not routinely enquire about trauma histories with this population and as a result, case notes underestimate trauma prevalence.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.
Background: It is important to assess the clinical competence of nursing students to gauge their professional development and educational needs. This can be measured by self-assessment tools. Anema and McCoy (2010) contended that the currently available measures need further psychometric testing.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.

Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to test the structural validity and scale properties, convergent and discriminant validity and reliability were subsequently tested.

Results: The NCQ provided evidence of a unidimensional scale which had strong scale scalability coefficients Hs =0.581; but limited evidence of item rankability HT =0.367. MSA undertaken with the SECP scale identified two potential unidimensional scales the SECP28 and SECP7, each with adequate evidence of good/reasonable scalablity psychometric properties as a summed scale but no/very limited evidence of scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/ SECP scale scores produced evidence of convergent and discriminant validity and good internal reliability: NCQ α = 0.93, SECP28 α = 0.96, and SECP7 α=0.89.

Discussion: The NCQ was verified to have evidence of reliability and validity; however, as the SECP findings are new, and the sample small, with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.

Conclusions: Measurement of perceived self-competence could inform the development of nursing competence and could start early in a nursing programme. Further testing of the NCQ and SECP scales with larger samples and from different years is indicated.


References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.