Standardizing the assessment of clinical competence: an overview of intensive care course design.

Rationale for the development of the Certificate in Health Studies: Intensive Care and High Dependency for Adults course developed at Queens University Belfast, Northern Ireland. Structure and content of clinical module reviewed. Clinical assessment strategy discussed. Focus on the utilization of a standardized portfolio, individualized learning contract and objective structured clinical examination (OSCE) to evaluate clinical competence. Evaluation of OSCE as an assessment tool and of the course provision.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.
Background: It is important to assess the clinical competence of nursing students to gauge their professional development and educational needs. This can be measured by self-assessment tools. Anema and McCoy (2010) contended that the currently available measures need further psychometric testing.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.

Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to test the structural validity and scale properties, convergent and discriminant validity and reliability were subsequently tested.

Results: The NCQ provided evidence of a unidimensional scale which had strong scale scalability coefficients Hs =0.581; but limited evidence of item rankability HT =0.367. MSA undertaken with the SECP scale identified two potential unidimensional scales the SECP28 and SECP7, each with adequate evidence of good/reasonable scalablity psychometric properties as a summed scale but no/very limited evidence of scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/ SECP scale scores produced evidence of convergent and discriminant validity and good internal reliability: NCQ α = 0.93, SECP28 α = 0.96, and SECP7 α=0.89.

Discussion: The NCQ was verified to have evidence of reliability and validity; however, as the SECP findings are new, and the sample small, with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.

Conclusions: Measurement of perceived self-competence could inform the development of nursing competence and could start early in a nursing programme. Further testing of the NCQ and SECP scales with larger samples and from different years is indicated.


References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

Computer usage and the validity of self-assessed computer competence among first-year business students

Abstract This study evaluates the reliability of self-assessment as a measure of computer competence. This evaluation is carried out in response to recent research which has employed self-reported ratings as the sole indicator of students’ computer competence. To evaluate the reliability of self-assessed computer competence, the scores achieved by students in self-assessed computer competence tests are compared with scores achieved in objective tests. The results reveal a statistically significantly over-estimation of computer competence among the students surveyed. Furthermore, reported pre-university computer experience in terms of home and school use and formal IT education does not affect this result. The findings call into question the validity of using self-assessment as a measure of computer competence. More generally, the study also provides an up-to-date picture of self-reported computer usage and IT experience among pre-university students from New Zealand and South-east Asia and contrasts these findings with those from previous research.

The effect of teachers trained in a fundamental movement skills programme on children’s self-perceptions and motor competence

Perceived and actual motor competence are hypothesized to have potential links to children and young people’s physical activity (PA) levels with a potential consequential link to long-term health. In this cross-sectional study, Harter’s (1985, Manual for the Self-perception Profile for Children. Denver, CO: University of Denver) Competency Motivation-based framework was used to explore whether a group of children taught, during curriculum time, by teachers trained in the Fundamental Movement Skills (FMS) programme, scored higher on self-perception and on core motor competencies when compared to children whose teachers had not been so trained. One hundred and seventy seven children aged 7–8 years participated in the study. One hundred and seven were taught by FMS-trained teachers (FMS) and the remaining 70 were taught by teachers not trained in the programme (non-FMS). The Harter Self-Perception Profile for Children assessed athletic competence, scholastic competence, global self-worth and social acceptance. Three core components of motor competence (body management, object control and locomotor skills) were assessed via child observation. The FMS group scored higher on all the self-perception domains (p < 0.05). Statistically significant differences were found between the schools on all of the motor tasks (p < 0.05). The relationships between motor performance and self-perception were generally weak and non-significant. Future research in schools and with teachers should explore the FMS programme’s effect on children’s motor competence via a longitudinal approach.

The four I-model for scaffolding the professional development of experienced teachers in the use of virtual learning environments for classroom teaching.

Models of professional development for teachers have been criticized for not being embedded in the context in which teachers are familiar, namely their own classrooms. This paper discusses an adapted-Continuous Practice Improvement model, which qualitative findings indicate was effective in facilitating the transfer of creative and innovative teaching approaches from the expert or Resident Teacher’s school to the novice or Visiting Teachers’ classrooms over the duration of the project. The cultural shift needed to embed and extend the use of online teaching across the school was achieved through the positive support and commitment of the principals in the Visiting Teachers’ schools, combined with the success of the professional development activities offered by the Visiting Teachers to their school-based colleagues.

The level playing field: the impact of assessment practice on professional development

Context: The effects of assessment practice on students’ learning are unclear, particularly regarding professional development. Corralling in objective structured clinical examinations (OSCEs) is designed to reduce illicit passing of examination information. Candidates completing an examination are kept secluded until the next cohort of examinees has begun. We used the introduction of corralling as a context in which to explore social influences on examination misconduct, with the aims of improving understanding of the hidden effects of assessment, and evaluating the acceptability of corralling from the student perspective.

Methods: A questionnaire was administered to students corralled post-OSCE for the first time. Eleven semi-structured interviews were subsequently conducted. Questionnaire data were analysed for descriptive statistics and thematic analysis of interview transcripts was carried out.

Results: The questionnaire response rate was 95.4% (251/263). Before corralling, 80.9% (203/251) of students were aware of the sharing of information among peers and 78.5% (197/251) agreed that such misconduct was unprofessional. The majority were in favour of corralling (90.8%, 228/251). Four themes emerged from the semi-structured interviews: the student network versus the individual; assessment-driven culture; the deferring of professionalism, and the ‘level playing field’. Students saw interaction within the student network, on a background of assessment-driven culture, as the key driver in examination misconduct. Conforming to the rules of the social network was prioritised over individual agency, although the mismatch between the rules of the network and the dominant professional discourse caused some conflict for individuals. Deferred professionalism (described as the practice of taking on the norms of professional behaviour only when qualified) was a rationalisation used to minimise this conflict. Corralling provided a ‘level playing field’ in which the influences of the network were minimised.

Conclusions: Examination misconduct is thus a complex social construction with implications for individual learners in terms of professional development. Corralling is one mechanism for addressing misconduct that is acceptable to students, but assessment processes have important hidden effects which educators should acknowledge.

The efficacy of a CDIO based integrated curriculum as preparation for professional practice in product design and development

The School of Mechanical and Aerospace Engineering at Queen’s University Belfast started BEng and MEng degree programmes in Product Design and Development (PDD) in 2004. Intended from the outset to be significantly different from the existing programmes within the School the PDD degrees used the syllabus and standards defined by the CDIO Initiative as the basis for an integrated curriculum. Students are taught in the context of conceiving, designing, implementing and operating a product. Fundamental to this approach is a core sequence of Design-Build-Test (DBT) experiences which facilitates the development of a range of professional skills as well as the immediate application of technical knowledge gained in strategically aligned supporting modules.
The key objective of the degree programmes is to better prepare students for professional practice. PDD graduates were surveyed using a questionnaire developed by the CDIO founders and interviewed to examine the efficacy of these degree programmes, particularly in this key objective. Graduate employment rates, self assessment of graduate attributes and examples of work produced by MEng graduates provided positive evidence that their capabilities met the requirements of the profession. The 24% questionnaire response rate from the 96 graduates to date did not however facilitate statistically significant conclusions to be drawn and particularly not for BEng graduates who were under represented in the response group. While not providing proof of efficacy the investigation did provide a good amount of useful data for consideration as part of a continuous improvement process.

Factors that impact on the use of mechanical ventilation weaning protocols in critically ill adults and children: a qualitative-evidence synthesis

Background:
Prolonged mechanical ventilation is associated with a longer intensive care unit (ICU) length of stay and higher mortality. Consequently, methods to improve ventilator weaning processes have been sought. Two recent Cochrane systematic reviews in ICU adult and paediatric populations concluded that protocols can be effective in reducing the duration of mechanical ventilation, but there was significant heterogeneity in study findings. Growing awareness of the benefits of understanding the contextual factors impacting on effectiveness has encouraged the integration of qualitative evidence syntheses with effectiveness reviews, which has delivered important insights into the reasons underpinning (differential) effectiveness of healthcare interventions.

Objectives:
1. To locate, appraise and synthesize qualitative evidence concerning the barriers and facilitators of the use of protocols for weaning critically-ill adults and children from mechanical ventilation;

2. To integrate this synthesis with two Cochrane effectiveness reviews of protocolized weaning to help explain observed heterogeneity by identifying contextual factors that impact on the use of protocols for weaning critically-ill adults and children from mechanical ventilation;

3. To use the integrated body of evidence to suggest the circumstances in which weaning protocols are most likely to be used.

Search methods:
We used a range of search terms identified with the help of the SPICE (Setting, Perspective, Intervention, Comparison, Evaluation) mnemonic. Where available, we used appropriate methodological filters for specific databases. We searched the following databases: Ovid MEDLINE, Embase, OVID, PsycINFO, CINAHL Plus, EBSCOHost, Web of Science Core Collection, ASSIA, IBSS, Sociological Abstracts, ProQuest and LILACS on the 26th February 2015. In addition, we searched: the grey literature; the websites of professional associations for relevant publications; and the reference lists of all publications reviewed. We also contacted authors of the trials included in the effectiveness reviews as well as of studies (potentially) included in the qualitative synthesis, conducted citation searches of the publications reporting these studies, and contacted content experts.

We reran the search on 3rd July 2016 and found three studies, which are awaiting classification.

Selection criteria:
We included qualitative studies that described: the circumstances in which protocols are designed, implemented or used, or both, and the views and experiences of healthcare professionals either involved in the design, implementation or use of weaning protocols or involved in the weaning of critically-ill adults and children from mechanical ventilation not using protocols. We included studies that: reflected on any aspect of the use of protocols, explored contextual factors relevant to the development, implementation or use of weaning protocols, and reported contextual phenomena and outcomes identified as relevant to the effectiveness of protocolized weaning from mechanical ventilation.

Data collection and analysis:
At each stage, two review authors undertook designated tasks, with the results shared amongst the wider team for discussion and final development. We independently reviewed all retrieved titles, abstracts and full papers for inclusion, and independently extracted selected data from included studies. We used the findings of the included studies to develop a new set of analytic themes focused on the barriers and facilitators to the use of protocols, and further refined them to produce a set of summary statements. We used the Confidence in the Evidence from Reviews of Qualitative Research (CERQual) framework to arrive at a final assessment of the overall confidence of the evidence used in the synthesis. We included all studies but undertook two sensitivity analyses to determine how the removal of certain bodies of evidence impacted on the content and confidence of the synthesis. We deployed a logic model to integrate the findings of the qualitative evidence synthesis with those of the Cochrane effectiveness reviews.

Main results:
We included 11 studies in our synthesis, involving 267 participants (one study did not report the number of participants). Five more studies are awaiting classification and will be dealt with when we update the review.

The quality of the evidence was mixed; of the 35 summary statements, we assessed 17 as ‘low’, 13 as ‘moderate’ and five as ‘high’ confidence. Our synthesis produced nine analytical themes, which report potential barriers and facilitators to the use of protocols. The themes are: the need for continual staff training and development; clinical experience as this promotes felt and perceived competence and confidence to wean; the vulnerability of weaning to disparate interprofessional working; an understanding of protocols as militating against a necessary proactivity in clinical practice; perceived nursing scope of practice and professional risk; ICU structure and processes of care; the ability of protocols to act as a prompt for shared care and consistency in weaning practice; maximizing the use of protocols through visibility and ease of implementation; and the ability of protocols to act as a framework for communication with parents.

Authors' conclusions:
There is a clear need for weaning protocols to take account of the social and cultural environment in which they are to be implemented. Irrespective of its inherent strengths, a protocol will not be used if it does not accommodate these complexities. In terms of protocol development, comprehensive interprofessional input will help to ensure broad-based understanding and a sense of ‘ownership’. In terms of implementation, all relevant ICU staff will benefit from general weaning as well as protocol-specific training; not only will this help secure a relevant clinical knowledge base and operational understanding, but will also demonstrate to others that this knowledge and understanding is in place. In order to maximize relevance and acceptability, protocols should be designed with the patient profile and requirements of the target ICU in mind. Predictably, an under-resourced ICU will impact adversely on protocol implementation, as staff will prioritize management of acutely deteriorating and critically-ill patients.

PROFESSIONAL LIABILITY OF AMATEURS: THE CONTEXT OF SPORTS COACHING

The developing intersection between the law of negligence and sports coaching in the UK provides a profoundly distinctive context, as compared to that of the more traditional learned professions, in which to critically examine the issue of professional liability. More specifically, detailed consideration of the Bolam test in the context of sports coaching, where the majority of coaches are volunteers, reinforces the Bolam doctrine as a control mechanism designed to protect both claimants and defendants alike. Importantly, a fuller analysis of related jurisprudence, even in instances where defendant coaches lack a formal qualification, and/or may not have engaged in considered and reasoned decision-making, reveals the potential for the Bolam test to operate as a quasi-defence, thereby safeguarding coaches from negligence liability. Nonetheless, in discharging this heightened standard of care incumbent upon them, coaches must ensure that the coaching practices adopted are regular, approved, and capable of withstanding robust and logical scrutiny. Ultimately, this article’s analysis of the principles of professional liability, in the specific circumstances of sports coaching, should prove to be of appreciably wider interest and utility for practitioners specialising in personal injury law.

Testing the psychometric properties of two self-report clinical competence scales for nursing students.

Background: It is important to assess the clinical competence of nursing students to gauge their educational needs. Competence can be measured by self-assessment tools; however, Anema and McCoy (2010) contend that currently available measures should be further psychometrically tested.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.
Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to investigate structural validity and scale properties; convergent and discriminant validity and reliability were also tested for each scale.
Results: MSA analysis identified that the NCQ is a unidimensional scale with strong scale scalability coefficients Hs =0.581; but limited item rankability HT =0.367. The SECP scale MSA suggested that the scale could be potentially split into two unidimensional scales (SECP28 and SECP7), each with good/reasonable scalablity psychometric properties as summed scales but negligible/very limited scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/SECP scores produced evidence of discriminant and convergent validity; good internal reliability was also found: NCQ α = 0.93, SECP28 α = 0.96 and SECP7 α=0.89.

Discussion: In line with previous research further evidence of the NCQ’s reliability and validity was demonstrated. However, as the SECP findings are new and the sample small with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.
Conclusions: Measurement of perceived self-competence could start early in a nursing programme to support students’ development of clinical competence. Further testing of the SECP scale with larger nursing student samples from different programme years is indicated.

References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

Implementing a resuscitation policy for patients at the end of life in an acute hospital setting: qualitative study

Objective : To explore attitudes and experiences of doctors and nurses regarding cardiopulmonary resuscitation for patients with end stage illness in an acute hospital. Design : Qualitative study; thematic analysis of two audio-taped focus groups and four semi-structured interviews. Setting : Acute district hospital, Northern Ireland. Participants : Seven nurses and nine doctors; varying nationality, gender and years of professional experience; involved in cardiopulmonary resuscitation decision-making. Results : Participants reported different interpretations of resuscitation policy and of what do not attempt to resuscitate (DNAR) decisions meant in relation to practical care for patients. This confusion in translating policy into practice contributed to communication difficulties in initiating, documenting and implementing cardiopulmonary resuscitation decisions. Participants were aware of how clinical conditions could change and reported uncertainty in determining end stage illness; they expressed fears of potential consequences of DNAR decisions for patients' care. The more disease-centred approach of doctors to patients' management, compared to nurses' more patient-centred approach, contributed to inter-professional conflict within teams. Doctors identified training needs in applying resuscitation policy and ethical principles in `real life' and nurses identified a need for ongoing professional support, which was perceived as being less available to junior doctors. Personal relationships between staff and patients, cultural reluctance to address sensitive issues and local community expectations of relatives being involved in decisions added to policy implementation difficulties. Conclusions : The findings indicate a need for ongoing staff support and training in applying resuscitation policy to decisions for patients with end stage illness in an acute hospital. They support suggestions that reviews of local resuscitation policy and of national guidelines should be undertaken with openness and honesty regarding the goals, opportunities and difficulties involved in trying to deliver good end of life care in local settings. Palliative Medicine 2007; 21 : 305—312 Key Words: do not attempt resuscitation (DNAR) • end stage illness • inter-professional • policy • resuscitation decisions

COMMUNICATION AND GREEK ENVIRONMENTAL ORGANISATIONS: MEANS OF COMMUNICATION AND INFLUENCING FACTORS

A basic operational objective of any environmental organisation is to raise awareness among the public on issues of environmental protection, through the dissemination of knowledge and experience to local communities, so that the conservation and ecologically sound management of natural resources can acquire a local dimension. This can be achieved either through interventions directed at the State, mainly in relation to its legislative function, or by encouraging citizens to change or improve their attitude regarding environmental matters. In order to ensure a successful outcome and the efficient functioning of any organisation, a feeling of mutual trust and understanding should exist between the latter and its various audiences, i.e. the State and society. A basic ingredient of this balance between the organisation, the broader public and the State is effective communication and activity planning. As a way of contributing to the exploration of this process, this paper describes the means of communication used by Greek environmental organisations, and presents, through a non-linear model, the differentiation amongst them, in conjunction with aspects of the profile of those running each organisation and other indicators, such as the years in operation and the membership figures in each sampled organisation. The paper concludes by arguing that the diversification of communication means is related to the head person's years as a member of the organisation and the extent of its total membership. Another important finding is that the more the involvement in activities within the organisation, the less differentiation we observe amongst the employed means of communication.

'Research Training and Professional Social Work Education: Developing Research-Minded Practice' Social Work Education, .

The movement towards developing practice more firmly grounded on empirical research has, arguably, been one of the most significant international trends in social work during the past decade. However, in the UK the implications of this trend for pedagogical practices and the design of educational programmes have still to be fully explored. This paper reports on the findings of a repeated cross-sectional survey of MSW students in Queen's University Belfast which focused on their perceptions of the value of research training to professional practice. The study, conducted over a four year period, explored students' awareness of the relationship between research and practice and their readiness to engage with research training. The findings suggested that the majority of students perceived research training as a valuable component of professional development. However, the study also found a level of scepticism among students about its practical utility along with some resistance towards actively embracing a research agenda. The paper evaluates the significance of these findings for developing research and evidence-based practice as integral components of the new degrees in social work in the UK and for social work education programmes in other countries aiming to develop research-minded practice.

The effect of statistics anxiety on students’ predicted and actual test scores

This study investigated the effect of statistics anxiety and attitudes on first year psychology students’ predicted and actual statistics class test scores. A total of 52 students completed the Statistics Anxiety Rating Scale and estimated their class test scores one week before their test at the end of first year. Regression models were conducted with the six attitude and anxiety subscales as predictors and the predicted and actual test scores as criterion variables. The results showed that computation self concept and fear of asking for help accounted for 37% of the variance in predicted test scores. However, when actual test scores were analysed the significant predictors were worth of statistics and interpretation anxiety, which accounted for 20% of the variance. These results suggested that while statistics anxiety does influence students’ perceptions of their competence it appears to have less effect on their actual performance. Results also suggested that students were unaware of their own statistical competence. Remedial action is required to address the level of statistics anxiety experienced by first year undergraduate psychology students, as it appears to result in unrealistic assessments of their ability and has detrimental effects on their statistics self-efficacy.