Testing the psychometric properties of two self-report clinical competence scales for nursing students.

Background: It is important to assess the clinical competence of nursing students to gauge their educational needs. Competence can be measured by self-assessment tools; however, Anema and McCoy (2010) contend that currently available measures should be further psychometrically tested.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.
Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to investigate structural validity and scale properties; convergent and discriminant validity and reliability were also tested for each scale.
Results: MSA analysis identified that the NCQ is a unidimensional scale with strong scale scalability coefficients Hs =0.581; but limited item rankability HT =0.367. The SECP scale MSA suggested that the scale could be potentially split into two unidimensional scales (SECP28 and SECP7), each with good/reasonable scalablity psychometric properties as summed scales but negligible/very limited scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/SECP scores produced evidence of discriminant and convergent validity; good internal reliability was also found: NCQ α = 0.93, SECP28 α = 0.96 and SECP7 α=0.89.

Discussion: In line with previous research further evidence of the NCQ’s reliability and validity was demonstrated. However, as the SECP findings are new and the sample small with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.
Conclusions: Measurement of perceived self-competence could start early in a nursing programme to support students’ development of clinical competence. Further testing of the SECP scale with larger nursing student samples from different programme years is indicated.

References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

Self-reported quality of life of 8-12 year old children with cerebral palsy: a cross-sectional European Study

Background

Little is known about the quality of life (QoL) of disabled children. We describe self-reported QoL of children with cerebral palsy, factors that influence it, and how it compares with QoL of the general population.

Methods

1174 children aged 8–12 years were randomly selected from eight population-based registers of children with cerebral palsy in six European countries and 743 (63%) agreed to participate; one further region recruited 75 children from multiple sources. Researchers visited these 818 children. 318 (39%) with severe intellectual impairment could not self-report; 500 (61%) reported their QoL using KIDSCREEN, an instrument with scores in ten domains, each with SD=10. Multivariable regression was used to relate QoL to impairments, pain, and sociodemographic characteristics. Comparisons were made with QoL data from the general population.

Findings

Impairments were not significantly associated with six KIDSCREEN domains. Comparison of least and most able groups showed that severely limited self-mobility was significantly associated with reduced mean score for physical wellbeing (7·6, 95% CI 2·7–12·4); intellectual impairment with reduced mean for moods and emotions (3·7, 1·5–5·9) and autonomy (3·3, 0·9–5·7); and speech difficulties with reduced mean for relationships with parents (4·5, 1·9–7·1). Pain was common and associated with lower QoL on all domains. Impairments and pain explained up to 3% and 7%, respectively, of variation in QoL. Children with cerebral palsy had similar QoL to children in the general population in all domains except schooling, in which evidence was equivocal, and physical wellbeing, in which comparison was not possible.

Interpretation

Parents can be reassured that most children aged 8–12 years with cerebral palsy will have similar QoL to other children. This finding should guide social and educational policy to ensure that disabled children participate fully in society. Because of its association with QoL, children's pain should be carefully assessed.

Anger, aggression, and self-harm in PTSD and complex PTSD

This study examined the contribution of complex posttraumatic stress disorder (PTSD) diagnosis and symptomatology to the difficulties of anger, aggression, and self-harm in a Northern Ireland clinical community sample. A "current complex PTSD" (CCPTSD) group (n = 11) was compared with a "current PTSD" group (n = 31) on self-report measures of these variables. The CCPTSD group demonstrated significantly higher levels of physical aggression and selfharm than the PTSD group. The complex PTSD symptom of 'alterations in self-perception' was a significant predictor of aggression and history of self-harm, suggesting the potential role of posttraumatic shame and self-loathing in PTSD theoretical models of these destructive behaviors. Social desirability was a notable confounding influence in the assessment of anger, aggression, and self-harm in traumatised individuals.

Peer tutoring in reading: The effects of role and organization on two dimensions of self-esteem

Background. Paired reading (PR) is an application of peer tutoring. It has been extensively researched, and its efficacy across a range of outcomes has been established. Benefits include improvements in key reading skills, and also in affective aspects of learning. Several studies have shown gains in self-esteem, although measurement methods have varied, and the model of self-esteem has rarely been clearly articulated.
Aims. To investigate the changes in self-esteem of children participating in a randomized trial of PR over a 15-week treatment period. To investigate the relative contribution of self-worth and self-competence to any gains in self-esteem. To investigate whether the pattern of change differs in children who take on different roles in the PR process.
Participants. The participants comprised a subset of a large-scale randomized trial of peer learning (The Fife Peer Learning Project). Four schools were randomly selected from schools allocated to the same-age PR condition, and four schools from those allocated to the cross-age PR condition. The same-age group consisted of 87 primary 6 children (10–11 years old). The cross-age group consisted of 81 primary 6 children. The controls, from schools randomly selected from a neighbouring authority, consisted of 92 primary 6 children.
Method. A pre–post design employing self-report measures of self-esteem. Rosenberg’s Self-Esteem Scale was used, with scores analysed for worth and competence. The treatment period was 15 weeks, with the participants following a prescribed PR process.
Results. Significant pre–post gains were noted in self-esteem, driven predominantly by improved beliefs about competence, in both same-age and cross-age conditions, but not for controls. Gains were also seen in self-worth in the cross-age condition. Further analyses of the influence of organizational condition (same-age or cross-age) and role played (tutor vs. tutee) showed significant differences between same-age tutors and cross-age tutors in relation to self-worth. Effect sizes were generally small or moderate.
Conclusions. The findings provide further support for the belief that PR can enhance self-esteem. Importantly, the use of a two-dimensional model provides extra information about self-perceptions in PR contexts: first, the central role of self- competence; and second, the gains in self-worth which are associated with tutoring younger children (but not same-age peers). This new information has educational significance for schools considering the potential of peer tutoring and the benefits of different organizational conditions.

The relationship between the recognition of facial expressions and self-reported anger in people with intellectual disabilities

Background This study aims to examine the relationship between how individuals with intellectual disabilities report their own levels of anger, and the ability of those individuals to recognize emotions. It was hypothesized that increased expression of anger would be linked to lower ability to recognize facial emotional expressions and increased tendency to interpret facial expressions in a hostile or negative manner. It was also hypothesized increased levels of anger may lead to the altered perception of a particular emotion.

Method A cross-sectional survey design was used. Thirty participants completed a test of facial emotion recognition (FER), and a self-report anger inventory (Benson & Ivins 1992) as part of a structured interview.

Results Individuals with higher self-reported anger did not show significantly reduced performance in FER, or interpret facial expressions in a more hostile manner compared with individuals with less self-reported anger. However, they were less accurate in recognizing neutral facial emotions.

Conclusions It is tentatively suggested that individuals with high levels of anger may be likely to perceive emotional content in a neutral facial expression because of their high levels of emotional arousal.

A randomized trial of paired tutoring in elementary schools:effects on self-esteem

This paper reports data on self-esteem collected during a large-scale randomized trial of paired reading and Duolog Maths with primary school children (The Fife Peer-Learning Project). Self-report measures were analysed to assess the effect of a range of organisational variables on measured self-esteem. The presentation reports findings from a sample of reading-only schools in the first year of the project. Statistically significant gains in self-esteem were found across a range of conditions. Patterns of scores pointed to differences between same-age and cross-age conditions, and highlighted the influence of role played (tutor v tutee). In addition to the findings summarized here, it is hoped that preliminary findings from year two of the project - with an increased sample size - will also be shared. © 2009.

Individual Characteristics Associated with Mismatches between Self-Reported and Accelerometer-Measured Physical Activity

Background: Accurate assessment tools are required for the surveillance of physical activity (PA) levels and the assessment of the effect of interventions. In addition, increasing awareness of PA is often used as the first step in pragmatic behavioural interventions, as discrepancies between the amount of activity an individual perceives they do and the amount actually undertaken may act as a barrier to change. Previous research has demonstrated differences in the amount of activity individuals report doing, compared to their level of physical activity when measured with an accelerometer. Understanding the characteristics of those whose PA level is ranked differently when measured with either self-report or accelerometry is important as it may inform the choice of instrument for future research. The aim of this project was to determine which individual characteristics are associated with differences between self-reported and accelerometer measured physical activity.

Methods: Participant data from the 2009 wave of the Commuting and Health in Cambridge study were used. Quartiles of self-reported and accelerometer measured PA were derived by ranking each measure from lowest to highest. These quartiles were compared to determine whether individuals’ physical activity was ranked higher by either method. Multinomial logistic regression models were used to investigate the individual characteristics associated with different categories of mismatch.

Results: Data from 486 participants (70% female) were included in the analysis. In adjusted analyses, the physical activity of overweight or obese individuals was significantly more likely to be ranked higher by self-report than by accelerometer than that of normal-weight individuals (OR = 2.07, 95%CI = 1.28–3.34), particularly among women (OR = 3.97, 95%CI = 2.11–7.47).

Conclusions: There was a greater likelihood of mismatch between self-reported and accelerometer measured physical activity levels in overweight or obese adults. Future studies in overweight or obese adults should consider employing both methods of measurement.

How Prepared are UK Medical Graduates for Practice? Final report from a programme of research commissioned by the General Medical Council

This programme of research aimed to understand the extent to which current UK medical graduates are prepared for practice. Commissioned by the General Medical Council, we conducted: (1) A Rapid Review of the literature between 2009 and 2013; (2) narrative interviews with a range of stakeholders; and (3) longitudinal audio-diaries with Foundation Year 1 doctors. The Rapid Review (RR) resulted in data from 81 manuscripts being extracted and mapped against a coding framework (including outcomes from Tomorrow's Doctors (2009) (TD09)). A narrative synthesis of the data was undertaken. Narrative interviews were conducted with 185 participants from 8 stakeholder groups: F1 trainees, newly registered trainee doctors, clinical educators, undergraduate and postgraduate deans and foundation programme directors, other healthcare professionals, employers, policy and government and patient and public representatives. Longitudinal audio-diaries were recorded by 26 F1 trainees over 4 months. The data were analysed thematically and mapped against TD09. Together these data shed light onto how preparedness for practice is conceptualised, measured, how prepared UK medical graduates are for practice, the effectiveness of transition interventions and the currently debated issue of bringing full registration forward to align with medical students’ graduation. Preparedness for practice was conceptualised as both a long- and short-term venture that included personal readiness as well as knowledge, skills and attitudes. It has mainly been researched using self-report measures of generalised incidents that have been shown to be problematic. In terms of transition interventions: assistantships were found to be valuable and efficacious for proactive students as team members, shadowing is effective when undertaken close to employment/setting of F1 post and induction is generally effective but of inconsistent quality. The August transition was highlighted in our interview and audio-diary data where F1s felt unprepared, particularly for the step-change in responsibility, workload, degree of multitasking and understanding where to go for help. Evidence of preparedness for specific tasks, skills and knowledge was contradictory: trainees are well prepared for some practical procedures but not others, reasonably well prepared for history taking and full physical examinations, but mostly unprepared for adopting an holistic understanding of the patient, involving patients in their care, safe and legal prescribing, diagnosing and managing complex clinical conditions and providing immediate care in medical emergencies. Evidence for preparedness for interactional and interpersonal aspects of practice was inconsistent with some studies in the RR suggesting graduates were prepared for team working and communicating with colleagues and patients, but other studies contradicting this. Interview and audio-diary data highlights concerns around F1s preparedness for communicating with angry or upset patients and relatives, breaking bad news, communicating with the wider team (including interprofessionally) and handover communication. There was some evidence in the RR to suggest that graduates were unprepared for dealing with error and safety incidents and lack an understanding of how the clinical environment works. Interview and audio-diary data backs this up, adding that F1s are also unprepared for understanding financial aspects of healthcare. In terms of being personally prepared, RR, interview and audio diary evidence is mixed around graduates’ preparedness for identifying their own limitations, but all data points to graduates’ difficulties in the domain of time management. In terms of personal and situational demographic factors, the RR found that gender did not typically predict perceptions of preparedness, but graduates from more recent cohorts, graduate entry students, graduates from problem based learning courses, UK educated graduates and graduates with an integrated degree reported feeling better prepared. The longitudinal audio-diaries provided insights into the preparedness journey for F1s. There seems to be a general development in the direction of trainees feeling more confident and competent as they gain more experience. However, these developments were not necessarily linear as challenging circumstances (e.g. new specialty, new colleagues, lack of staffing) sometimes made them feel unprepared for situations where they had previously indicated preparedness.

Cancer survivors with self-reported late effects: their health status, care needs and service utilisation

OBJECTIVE: Cancer survivors (CSs) are at risk of developing late effects (LEs) associated with the disease and its treatment. This paper compares the health status, care needs and use of health services by CSs with LEs and CSs without LEs.

METHODS: Cancer survivors (n = 613) were identified via the Northern Ireland Cancer Registry and invited to participate in a postal survey that was administered by their general practitioner. The survey assessed self-reported LEs, health status, health service use and unmet care needs. A total of 289 (47%) CSs responded to the survey, and 93% of respondents completed a LEs scale.

RESULTS: Forty-one per cent (111/269) of CSs reported LEs. Survivors without LEs and survivors with LEs were comparable in terms of age and gender. The LEs group reported a significantly greater number of co-morbidities, lower physical health and mental health scores, greater overall health service use and more unmet needs. Unadjusted logistic regression analysis found that cancer site, time since diagnosis and treatment were significantly associated with reporting of LEs. CSs who received combination therapies compared with CSs who received single treatments were over two and a half times more likely to report LEs (OR = 2.63, 95% CI = 1.32-5.25) after controlling for all other variables.

CONCLUSIONS: The CS population with LEs comprises a particularly vulnerable group of survivors who have multiple health care problems and needs and who require tailored care plans that take account of LEs and their impact on health-related quality of life.

An Informant Report Behavior Diary for Measuring Temper Outbursts in an Intervention Setting

Temper outbursts are associated with several psychological disorders and comprise a high priority for intervention. However, the low frequency of outbursts presents a challenge for valid measurement. In the present study an informant report behavior diary for measuring temper outbursts was developed and its validity assessed in a case series. Caregivers of 12 individuals with the neurodevelopmental disorder Prader-Willi syndrome (PWS, in which temper outbursts are common) completed a behavior diary over 4 weeks, and a structured interview. Heart rate and movement data were recorded during a sample of the days subject to diary reporting. Individuals with PWS completed self-report ratings of negative emotion experience. Behavior diaries showed high concordance with the component behaviors and duration of temper outbursts reported in structured interviews; but tended to report a lower frequency. For outbursts reported in diaries during physiological recording, heart rate was consistently elevated above a resting state baseline; and was comparable to that recorded during high physical activity. Available self-report data demonstrated correspondence with the diaries but few self-report data were produced. The present results provide critical proof of principle data supporting the concurrent validity of the ecologically valid, resource efficient diaries, which can be exploited in future research.

Perceptions of stressful life events in Northern Irish school children: a longitudinal study.

Adults’ perceptions of stressful life events have been acknowledged as important moderators of the stress adjustment relationship. Until recently, however, there has been a lack of research on children's perceptions of negative life events. This study assesses children's own perceptions of the stressfulness of negative familial, academic and social events as well as events related to the political conflict in Northern Ireland. Method: Developmental changes in children's perceptions of events are traced over time. One hundred and sixty 8-year-old children completed a self-report measure of the perceived stressfulness of a range of negative life events. The sample was drawn from schools in the Greater Belfast area to include children of both genders, primary religious affiliations in Northern Ireland (i.e., Protestant and Roman Catholic) and of varying socio-economic status. Three years later, 113 of these children, then aged 11, were traced through the school system and completed the same measure. Results: Children's perceptions of stressful events are related to a host of social factors. Girls viewed many negative events as more stressful than their male counterparts. Roman Catholic and Protestant children differed in their perceptions of conflict-related events. Perceptions of various types of negative experiences were differentially related to socio-economic status and age. Conclusion: Personal, social and situational factors differentially determine children's perceptions of negative life experiences.

Aggression after traumatic brain injury: Analysing socially desirable responses and the nature of aggressive traits.

Primary objective: To compare patients with traumatic brain injury (TBI) with controls on sub-types of aggression and explore the role of social desirability.
Design: Quasi-experimental, matched-participants design.
Methods and procedures: Sixty-nine participants were included in the study. The sample comprised a TBI group (n = 24), a spinal cord injury (SCI) group (n = 21) and an uninjured (UI) group of matched healthy volunteers (n = 24). Participants were given self-report measures of aggression, social desirability and impulsivity. Sixty-one independent ‘other-raters’ were nominated, who rated participant pre-morbid and post-morbid aggression.
Main outcomes and results: Using standardized norms, 25–39% of participants with TBI were classified as high average–very high on anger and 35–38% as high average–very high on verbal aggression. Other-raters rated participants with TBI as significantly higher on verbal aggression than SCI and UI participants. There were no differences between the groups on physical aggression. The TBI group also had higher levels of impulsivity than SCI and UI groups. Social desirability was a highly significant predictor of self-reported aggression for the entire sample.
Conclusions: Impulsive verbal aggression and anger are the principal aggressive traits after brain injury. Physical aggression may present in extreme cases after TBI, but appears less prominent overall in this population. Social desirability, previously overlooked in research examining TBI aggression, emerged as an influential variable that should be considered in future TBI research.

Assessment of data quality in a multi-centre cross-sectional study of participation and quality of life of children with cerebral palsy

Background: SPARCLE is a cross-sectional survey in nine European regions, examining the relationship of the environment of children with cerebral palsy to their participation and quality of life. The objective of this report is to assess data quality, in particular heterogeneity between regions, family and item non-response and potential for bias. Methods: 1,174 children aged 8–12 years were selected from eight population-based registers of children with cerebral palsy; one further centre recruited 75 children from multiple sources. Families were visited by trained researchers who administered psychometric questionnaires. Logistic regression was used to assess factors related to family non-response and self-completion of questionnaires by children. Results: 431/1,174 (37%) families identified from registers did not respond: 146 (12%) were not traced; of the 1,028 traced families, 250 (24%) declined to participate and 35 (3%) were not approached. Families whose disabled children could walk unaided were more likely to decline to participate. 818 children entered the study of which 500 (61%) self-reported their quality of life; children with low IQ, seizures or inability to walk were less likely to self-report. There was substantial heterogeneity between regions in response rates and socio-demographic characteristics of families but not in age or gender of children. Item non-response was 2% for children and ranged from 0.4% to 5% for questionnaires completed by parents. Conclusion: While the proportion of untraced families was higher than in similar surveys, the refusal rate was comparable. To reduce bias, all analyses should allow for region, walking ability, age and socio-demographic characteristics. The 75 children in the region without a population based register are unlikely to introduce bias

Determinants of Child-Parent Agreement in Quality-of-Life Reports: A European Study of Children With Cerebral Palsy

OBJECTIVES: The differences between child self-reports and parent proxy reports of quality of life in a large population of children with cerebral palsy were studied. We examined whether child characteristics, severity of impairment, socioeconomic factors, and parental stress were associated with parent proxy reports being respectively higher or lower than child self-reports of quality of life. METHODS. This study was conducted in 2004–2005 and assessed child quality of life (using the Kidscreen questionnaire, 10 domains, each scored 0–100) through self-reports and parent proxy reports of 500 children aged 8 to 12 years who had cerebral palsy and were living in 7 countries in Europe. RESULTS: The mean child-reported scores of quality of life were significantly higher than the parent proxy reports in 8 domains, significantly lower for the finances domain, and similar for the emotions domain. The average frequency of disagreement (child-parent difference greater than half an SD of child scores) over all domains was 64%, with parents rating their child’s quality of life lower than the children themselves in 29% to 57% of child-parent pairs. We found that high levels of stress in parenting negatively influenced parents’ perception of their child’s quality of life, whereas the main factor explaining parents’ ratings of children’s quality of life higher than the children themselves is self-reported severe child pain. CONCLUSIONS: This study shows that the factors associated with disagreement are different according to the direction of disagreement. In particular, parental wellbeing and child pain should be taken into account in the interpretation of parent proxy reports, especially when no child self-report of quality of life is available. In the latter cases, it may be advisable to obtain additional proxy reports (from caregivers, teachers, or clinicians) to obtain complementary information on the child’s quality of life.

Depressed mood and dietary fish intake: Direct relationship or indirect relationship as a result of diet and lifestyle?

Previous studies have suggested an association between depressed mood and the dietary intake of fish. In all cases, however, dietary fish intake has been considered at the exclusion of all other aspects of the diet. This analysis investigates associations between depressed mood and dietary fish intake, while also concurrently investigating intake of a number of other dietary components. The analysis is conducted on data from 10,602 men from Northern Ireland and France screened for inclusion into the PRIME cohort study. Depressed mood was assessed using a self-report questionnaire based on the Welsh Pure Depression sub-scale of the Minnesota Multiphasic Personality Inventory, diet was assessed using a Food Frequency Questionnaire, and limited demographics were also measured. Using regression, depressed mood is initially inversely associated with dietary fish intake. On inclusion of all other dietary variables, the strength of this relationship reduces but remains, and significant associations with a number of other foods are also found. On additional inclusion of all demographic variables, the strength of the above relationships again reduces, and associations with various measures of socio-economic status and education are also significant. These findings suggest that depressed mood is associated with fish intake both directly, and indirectly as part of a diet that is associated with depression and as part of a lifestyle that is associated with depression. Additional support for these conclusions is also provided in the pattern of associations between depressed mood and diet in the two countries. The relative contributions of fish intake to depressed mood both directly and indirectly are yet to be determined. However, while diet is not measured and until lifestyle can be adequately measured, the potential roles of diet and lifestyle in the association between depressed mood and dietary fish intake should not be ignored.