Can less be more? Comparison of an 8-item placement quality measure with the 50-item Dundee Ready Educational Environment Measure (DREEM)

Clinical clerks learn more than they are taught and not all they learn can be measured. As a result, curriculum leaders evaluate clinical educational environments. The quantitative Dundee Ready Environment Measure (DREEM) is a de facto standard for that purpose. Its 50 items and 5 subscales were developed by consensus. Reasoning that an instrument would perform best if it were underpinned by a clearly conceptualized link between environment and learning as well as psychometric evidence, we developed the mixed methods Manchester Clinical Placement Index (MCPI), eliminated redundant items, and published validity evidence for its 8 item and 2 subscale structure. Here, we set out to compare MCPI with DREEM. 104 students on full-time clinical placements completed both measures three times during a single academic year. There was good agreement and at least as good discrimination between placements with the smaller MCPI. Total MCPI scores and the mean score of its 5-item learning environment subscale allowed ten raters to distinguish between the quality of educational environments. Twenty raters were needed for the 3-item MCPI training subscale and the DREEM scale and its subscales. MCPI compares favourably with DREEM in that one-sixth the number of items perform at least as well psychometrically, it provides formative free text data, and it is founded on the widely shared assumption that communities of practice make good learning environments.

Realistic evaluation of EWS and ALERT: factors enabling and constraining implementation.

Realistic Evaluation of EWS and ALERT: factors enabling and constraining implementation Background The implementation of EWS and ALERT in practice is essential to the success of Rapid Response Systems but is dependent upon nurses utilising EWS protocols and applying ALERT best practice guidelines. To date there is limited evidence on the effectiveness of EWS or ALERT as research has primarily focused on measuring patient outcomes (cardiac arrests, ICU admissions) following the implementation of a Rapid Response Team. Complex interventions in healthcare aimed at changing service delivery and related behaviour of health professionals require a different research approach to evaluate the evidence. To understand how and why EWS and ALERT work, or might not work, research needs to consider the social, cultural and organisational influences that will impact on successful implementation in practice. This requires a research approach that considers both the processes and outcomes of complex interventions, such as EWS and ALERT, implemented in practice. Realistic Evaluation is such an approach and was used to explain the factors that enable and constrain the implementation of EWS and ALERT in practice [1]. Aim The aim of this study was to evaluate factors that enabled and constrained the implementation and service delivery of early warnings systems (EWS) and ALERT in practice in order to provide direction for enabling their success and sustainability. Methods The research design was a multiple case study approach of four wards in two hospitals in Northern Ireland. It followed the principles of realist evaluation research which allowed empirical data to be gathered to test and refine RRS programme theory. This approach used a variety of mixed methods to test the programme theories including individual and focus group interviews, observation and documentary analysis in a two stage process. A purposive sample of 75 key informants participated in individual and focus group interviews. Observation and documentary analysis of EWS compliance data and ALERT training records provided further evidence to support or refute the interview findings. Data was analysed using NVIVO8 to categorise interview findings and SPSS for ALERT documentary data. These findings were further synthesised by undertaking a within and cross case comparison to explain the factors enabling and constraining EWS and ALERT. Results A cross case analysis highlighted similarities, differences and factors enabling or constraining successful implementation across the case study sites. Findings showed that personal (confidence; clinical judgement; personality), social (ward leadership; communication), organisational (workload and staffing issues; pressure from managers to complete EWS audit and targets), educational (constraints on training; no clinical educator on ward) and cultural (routine task delegated) influences impact on EWS and acute care training outcomes. There were also differences noted between medical and surgical wards across both case sites. Conclusions Realist Evaluation allows refinement and development of the RRS programme theory to explain the realities of practice. These refined RRS programme theories are capable of informing the planning of future service provision and provide direction for enabling their success and sustainability. References: 1. McGaughey J, Blackwood B, O’Halloran P, Trinder T. J. & Porter S. (2010) A realistic evaluation of Track and Trigger systems and acute care training for early recognition and management of deteriorating ward–based patients. Journal of Advanced Nursing 66 (4), 923-932. Type of submission: Concurrent session Source of funding: Sandra Ryan Fellowship funded by the School of Nursing & Midwifery, Queen’s University of Belfast

Does mothers' postnatal depression influence the development of imitation?

Background: Links between mothers' postnatal depression (PND) and children's cognition have been identified in several samples, but the evidence is inconsistent. We hypothesized that PND may specifically interfere with infants' imitation, an early learning ability that features in early mother-infant interaction and is linked to memory, causal understanding and joint attention. 

Methods: A randomly controlled experiment on imitation was embedded into a longitudinal study of a representative sample of firstborn British infants, whose mothers were assessed for depression using the SCAN interview during pregnancy and at 6 months postpartum. At a mean of 12.8 months, 253 infants were presented with two imitation tasks that varied in difficulty, in counterbalanced order. 

Results: The infants of mothers who experienced PND were significantly less likely than other infants in the sample to imitate the modelled actions, showing a 72% reduction in the likelihood of imitation. The association with PND was not explained by sociodemographic adversity, or a history of depression during pregnancy or prior to conception. Mothers' references to infants' internal states during mother-infant interaction at 6 months facilitated imitation at 12 months, but did not explain the link with PND. 

Conclusions: The findings support the hypothesis that associations between PND and later cognitive outcomes may partly derive from effects of the mother's illness on infants' early learning abilities. Support for infants' learning should be considered as an age-appropriate, child-focused component of interventions designed to ameliorate the effects of PND.

Paving the way for the use of the SDQ in economic evaluations of school-based population health interventions: an empirical analysis of the external validity of SDQ mapping algorithms to the CHU9D in an educational setting

Purpose
The Strengths and Difficulties Questionnaire (SDQ) is a behavioural screening tool for children. The SDQ is increasingly used as the primary outcome measure in population health interventions involving children, but it is not preference based; therefore, its role in allocative economic evaluation is limited. The Child Health Utility 9D (CHU9D) is a generic preference-based health-related quality of-life measure. This study investigates the applicability of the SDQ outcome measure for use in economic evaluations and examines its relationship with the CHU9D by testing previously published mapping algorithms. The aim of the paper is to explore the feasibility of using the SDQ within economic evaluations of school-based population health interventions.
Methods
Data were available from children participating in a cluster randomised controlled trial of the school-based roots of empathy programme in Northern Ireland. Utility was calculated using the original and alternative CHU9D tariffs along with two SDQ mapping algorithms. t tests were performed for pairwise differences in utility values from the preference-based tariffs and mapping algorithms.
Results
Mean (standard deviation) SDQ total difficulties and prosocial scores were 12 (3.2) and 8.3 (2.1). Utility values obtained from the original tariff, alternative tariff, and mapping algorithms using five and three SDQ subscales were 0.84 (0.11), 0.80 (0.13), 0.84 (0.05), and 0.83 (0.04), respectively. Each method for calculating utility produced statistically significantly different values except the original tariff and five SDQ subscale algorithm.
Conclusion
Initial evidence suggests the SDQ and CHU9D are related in some of their measurement properties. The mapping algorithm using five SDQ subscales was found to be optimal in predicting mean child health utility. Future research valuing changes in the SDQ scores would contribute to this research.

Effect of providing free glasses on children's educational outcomes in China: cluster randomized controlled trial

Objective: To assess the effect of provision of free glasses on academic performance in rural Chinese children with myopia. Design: Cluster randomized, investigator masked, controlled trial.Setting 252 primary schools in two prefectures in western China, 2012-13. Participants: 3177 of 19 934 children in fourth and fifth grades (mean age 10.5 years) with visual acuity <6/12 in either eye without glasses correctable to >6/12 with glasses. 3052 (96.0%) completed the study.Interventions Children were randomized by school (84 schools per arm) to one of three interventions at the beginning of the school year: prescription for glasses only (control group), vouchers for free glasses at a local facility, or free glasses provided in class. Main outcome measures: Spectacle wear at endline examination and end of year score on a specially designed mathematics test, adjusted for baseline score and expressed in standard deviations. Results: Among 3177 eligible children, 1036 (32.6%) were randomized to control, 988 (31.1%) to vouchers, and 1153 (36.3%) to free glasses in class. All eligible children would benefit from glasses, but only 15% wore them at baseline. At closeout glasses wear was 41% (observed) and 68% (self reported) in the free glasses group, and 26% (observed) and 37% (self reported) in the controls. Effect on test score was 0.11 SD (95% confidence interval 0.01 to 0.21) when the free glasses group was compared with the control group. The adjusted effect of providing free glasses (0.10, 0.002 to 0.19) was greater than parental education (0.03, −0.04 to 0.09) or family wealth (0.01, −0.06 to 0.08). This difference between groups was significant, but was smaller than the prespecified 0.20 SD difference that the study was powered to detect. Conclusions: The provision of free glasses to Chinese children with myopia improves children’s performance on mathematics testing to a statistically significant degree, despite imperfect compliance, although the observed difference between groups was smaller than the study was originally designed to detect. Myopia is common and rarely corrected in this setting. Trial Registration: Current Controlled Trials ISRCTN03252665.

Ophthalmology. 2011 Dec;118(12):2343-50. doi: 10.1016/j.ophtha.2011.06.016. Epub 2011 Sep 1. Randomized, controlled trial of an educational intervention to promote spectacle use in rural China: the see well to learn well study.

OBJECTIVE: To test an educational intervention promoting the purchase of spectacles among Chinese children. DESIGN: Randomized, controlled trial. PARTICIPANTS: Children in years 1 and 2 of all 20 junior and senior high schools (ages 12-17 years) in 3 rural townships in Guangdong, China. METHODS: Children underwent visual acuity (VA) testing, and parents of participants with presenting VA worse than 6/12 in either eye improving by more than 2 lines with cycloplegic refraction were recommended to purchase glasses. Children at 10 randomly selected schools received a lecture, video, and classroom demonstration promoting spectacle purchase. MAIN OUTCOME MEASURES: Self-reported purchase of spectacles (primary outcome) and observed wear or possession of newly purchased glasses (secondary outcome) at follow-up examinations (mean, 219 ± 87 days after the baseline visit). RESULTS: Among 15 404 eligible children, examinations were completed for 6379 (74.6%) at intervention schools and 5044 (73.6%) at control schools. Spectacles were recommended for 2236 (35.1%) children at intervention schools and for 2212 (43.9%) at control schools. Of these, 417 (25.7%) intervention schools children and 537 (34.0%, P = 0.45) control schools children reported buying glasses. Predictors of purchase in regression models included female gender (P = 0.02), worse uncorrected VA (P < 0.001), and higher absolute value of refractive error (P = 0.001). Neither the rate of self-reported purchase of glasses or observed wear or possession of newly purchased glasses differed between control schools and intervention schools in mixed-effect logistic regression models. Among children not purchasing glasses, 21.7% had better-eye VA of worse than 6/18. CONCLUSIONS: An intervention based on extensive pilot testing and focus groups in the area failed to promote spectacle purchase or wear. The high burden of remaining uncorrected poor vision underscores the need to develop better interventions. FINANCIAL DISCLOSURE(S): The author(s) have no proprietary or commercial interest in any materials discussed in this article.

Diabetes Distress: Understanding the Hidden Struggles of Living with Diabetes and Exploring Intervention Strategies

Diabetes Distress is a rational emotional response to the threat of a life-changing illness. Distinct from depression, it is rooted in the demands of diabetes management and is a product of psychological adjustment. Diabetes distress has been found to be significantly associated with HbA1c and self-care, which demonstrates its clinical use in treatment outcomes. Interpersonal factors such as perceived support and protectiveness of partners significantly contribute to elevated distress, suggesting that these are valued areas of focus for interventions. Pioneering large-scale research, DAWN2, gives voices to the families of those with diabetes and reaffirms the need to consider psychosocial factors in routine diabetes care. Structured diabetes education programmes are the most widely used in helping individuals cope with diabetes, but they fail to consider the psychological or interpersonal aspects of diabetes management. Psycho-educational approaches are found to be effective in reducing diabetes distress while also improving HbA1c. Certain limitations in the current literature are discussed, along with future directions. Of utmost importance is the need for health practitioners, irrespective of background, to demonstrate an understanding of diabetes distress and actively engage in discussion with individuals struggling to cope with diabetes; to normalize this and integrate it into routine diabetes practice.

Allocating Participants to Groups In Educational Trials: What Does Random Mean?

What is meant by the term random? Do we understand how to identify which type of randomisation to use in our future research projects? We, as researchers, often explain randomisation to potential research participants as being a 50/50 chance of selection to either an intervention or control group, akin to drawing numbers out of a hat. Is this an accurate explanation? And are all methods of randomisation equal? This paper aims to guide the researcher through the different techniques used to randomise participants with examples of how they can be used in educational research.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.
Background: It is important to assess the clinical competence of nursing students to gauge their professional development and educational needs. This can be measured by self-assessment tools. Anema and McCoy (2010) contended that the currently available measures need further psychometric testing.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.

Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to test the structural validity and scale properties, convergent and discriminant validity and reliability were subsequently tested.

Results: The NCQ provided evidence of a unidimensional scale which had strong scale scalability coefficients Hs =0.581; but limited evidence of item rankability HT =0.367. MSA undertaken with the SECP scale identified two potential unidimensional scales the SECP28 and SECP7, each with adequate evidence of good/reasonable scalablity psychometric properties as a summed scale but no/very limited evidence of scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/ SECP scale scores produced evidence of convergent and discriminant validity and good internal reliability: NCQ α = 0.93, SECP28 α = 0.96, and SECP7 α=0.89.

Discussion: The NCQ was verified to have evidence of reliability and validity; however, as the SECP findings are new, and the sample small, with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.

Conclusions: Measurement of perceived self-competence could inform the development of nursing competence and could start early in a nursing programme. Further testing of the NCQ and SECP scales with larger samples and from different years is indicated.


References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

Undergraduate interprofessional education using high-fidelity paediatric simulation

BACKGROUND: High-fidelity simulation is becoming increasingly important in the delivery of teaching and learning to health care professionals within a safe environment. Its use in an interprofessional context and at undergraduate level has the potential to facilitate the learning of good communication and teamworking, in addition to clinical knowledge and skills.

METHODS: Interprofessional teaching and learning workshops using high-fidelity paediatric simulation were developed and delivered to undergraduate medical and nursing students at Queen's University Belfast. Learning outcomes common to both professions, and essential in the clinical management of sick children, included basic competencies, communication and teamworking skills. Quantitative and qualitative evaluation was undertaken using published questionnaires.

RESULTS: Quantitative results - the 32-item questionnaire was analysed for reliability using spss. Responses were positive for both groups of students across four domains - acquisition of knowledge and skills, communication and teamworking, professional identity and role awareness, and attitudes to shared learning. Qualitative results - thematic content analysis was used to analyse open-ended responses. Students from both groups commented that an interprofessional education (IPE) approach to paediatric simulation improved clinical and practice-based skills, and provided a safe learning environment. Students commented that there should be more interprofessional and simulation learning opportunities.

DISCUSSION: High-fidelity paediatric simulation, used in an interprofessional context, has the potential to meet the requirements of undergraduate medical and nursing curricula. Further research is needed into the long-term benefits for patient care, and its generalisability to other areas within health care teaching and learning.

How to promote professional competence and identity in social work students

Background: Field placement experiences are frequently cited in the literature as having most impact on a student social worker’s learning as they emerge into the profession. Placements are integral to the development of practice competence and in acquiring a sense of social work identity. However research on the effectiveness of educational strategies used to deliver learning and assess competence during placement are scarce. Internationally, pressures to meet increasing numbers of student enrolments have raised concerns about the potential impact on the quality of placements and practice teaching provided. These pressures may also impact on the appropriate transfer and application of learning to the student’s practice.
Aim: To identify learning activities rated most useful for developing professional practice competence and professional identity of social work students.
Method: Data were collected from 396 students who successfully completed their first or final placement during 2013-2014 and were registered at one of two Universities in Northern Ireland. Students completed a self-administered questionnaire which covered: placement setting and service user group; type of supervision model; frequency of undertaking specific learning activities; who provided the learning; which activities contributed to their developing professional competence and identity and their overall satisfaction.
Our findings confirmed the centrality of the supervisory relationship as the vehicle to enable quality student learning. Shadowing others, receiving regular supervision and receiving constructive feedback were the tasks that students reported as ‘most useful’ to developing professional identity, competence and readiness to practice. Disturbingly over 50% of students reported that linking practice to the professional codes, practice foci and key roles were not valued as ‘useful’ in terms of readiness to practice, feeling competent and developing professional social work identity. These results offer strong insights into how both the University and the practice placement environment needs to better prepare, assess and support students during practice placements in the field.