Measuring critical thinking skills and dispositions in undergraduate students

This thesis investigates critical thinking with a particular focus on measurement in undergraduate students. A higher education context was chosen because many regard critical thinking development as a primary goal for third level education. Nine studies, both cross-sectional and longitudinal in design, were conducted with undergraduate psychology students (N=387), using the California Critical Thinking Disposition Inventory (CCTDI) and the California Critical Thinking Skills Test (CCTST). Studies 1-3 revealed psychometric weaknesses in the CCTDI and revised the scale with factor analysis and reliability analysis to form the CCTDI United Kingdom revision (CCTDI-UK). Study 4 investigated convergent validity and showed significant inter-correlation between the sub-scales of the CCTDI-UK, and significant correlations with the Openness scale of the NEO Personality Inventory (NEO PI-R). The study also provided evidence for improvement in scores on three of the six sub-scales in the CCTDI-UK (Truth-Seeking, Inquisitiveness, Open-Mindedness) during the course of an undergraduate degree. Study 5 explored a two factor structure for critical thinking dispositions. Study 6 used reliability analysis to revise the CCTST to produce the CCTST-UK. Study 7 showed that the CCTST-UK had a moderate correlation with degree attainment and a slightly higher correlation with a test of non-verbal intelligence (Raven’s Advanced Progressive Matrices short form); in addition, the study showed that scores on the CCTST-UK improved during the course of the degree. Studies 8 and 9 investigated the potential of critical thinking for predicting degree attainment. A-levels predicted approximately 10% of the variance of degree attainment while entry level scores on the CCTST-UK predicted an additional 5%. Exit level scores on the CCTST-UK and the Inquisitive sub-scale of the CCTDI-UK were found to be predictors of degree attainment The main conclusions of the thesis were that these tests had significant potential for predicting degree attainment and that they measured a substantial proportion of the theoretical constructs identified by the major authors in critical thinking.

The structure of the Statistics Anxiety Rating Scale: A confirmatory factor analysis using UK psychology students

This study aimed to examine the structure of the statistics anxiety rating scale. Responses from 650 undergraduate psychology students throughout the UK were collected through an on-line study. Based on previous research three different models were specified and estimated using confirmatory factor analysis. Fit indices were used to determine if the model fitted the data and a likelihood ratio difference test was used to determine the best fitting model. The original six factor model was the best explanation of the data. All six subscales were intercorrelated and internally consistent. It was concluded that the statistics anxiety rating scale was found to measure the six subscales it was designed to assess in a UK population.

The effect of statistics anxiety on students’ predicted and actual test scores

This study investigated the effect of statistics anxiety and attitudes on first year psychology students’ predicted and actual statistics class test scores. A total of 52 students completed the Statistics Anxiety Rating Scale and estimated their class test scores one week before their test at the end of first year. Regression models were conducted with the six attitude and anxiety subscales as predictors and the predicted and actual test scores as criterion variables. The results showed that computation self concept and fear of asking for help accounted for 37% of the variance in predicted test scores. However, when actual test scores were analysed the significant predictors were worth of statistics and interpretation anxiety, which accounted for 20% of the variance. These results suggested that while statistics anxiety does influence students’ perceptions of their competence it appears to have less effect on their actual performance. Results also suggested that students were unaware of their own statistical competence. Remedial action is required to address the level of statistics anxiety experienced by first year undergraduate psychology students, as it appears to result in unrealistic assessments of their ability and has detrimental effects on their statistics self-efficacy.

An Innovative teaching tool for students is it Appropriate?

Background: Clinical supervision takes place once the newly qualified nurse is employed in clinical practice. However, often the variety and diversity of nursing jobs can result in a hit and miss delivery of supervision training. By introducing training uniformly at undergraduate stage a more seamless transition may occur (McColgan K, Rice C. 2012).

There is an increased interest in higher education in the use of online learning resources for students. As part completion of a DNP an App. for training students in clinical supervision was developed.

Aim: The creation of a clinical supervision training App. for use in undergraduate nursing.

Objectives:
•To develop a teaching tool that is up to date, current and easily accessible to students.
•To introduce supervision training for undergraduate nursing students
•To motivate the undergraduate nursing student to identify examples from their clinical experience to encourage change and promote professional development.

Approach:
Stage 1
In 2010/11 informal inquiries with senior nurses regarding the introduction of supervision training in undergraduate nursing
Stage 2
A review of UK supervision training.
Stage 3
Template production of teaching tool.
Stage 4
Collaboration with a computer technician to transfer multimedia outputs onto an App.
Stage 5
App. piloted with lecturers (n=4) and post registration students (n=20).
Stage 6
Minor alterations made to App. design template
Stage 7
App. included in an experimental study looking at online learning versus blended learning June 2013 (n=61, n=63)

Conclusion: A collaborative approach to the development of any educational programme is essential to ensure the success of the final teaching product (McCutcheon 2013). The end result is that this App. could be:
•Made available to nurses in the UK.
•Adapted to suit other healthcare professionals and students.
•Used as a prototype for other healthcare related subjects.

McColgan K., Rice C. (2012) An online training resource for clinical supervision. Nursing Standard, 26(24) 35-39.
McCutcheon K. (2013) Development of a multi-media book for clinical supervision training in an undergraduate nursing programme. Journal of Nursing Education and Practice, 3(5) 31-38.

A study to evaluate the introduction of simulation as a teaching strategy for the mental health and learning disability fields of nursing, in an undergraduate nursing curriculum within one higher education institution

High Fidelity Simulation or Human Patient Simulation is an educational strategy embedded within nursing curricula throughout many healthcare educational institutions. This paper reports on an evaluative study that investigated the views of a group of Year 2 undergraduate nursing students from the mental health and the learning disability fields of nursing (n = 75) in relation to simulation as a teaching pedagogy. The study took place in the simulation suite within a School of Nursing and Midwifery in the UK. Two patient scenarios were used for the session and participants completed a 22-item questionnaire consisting of three biographical information questions and a 19-item Likert scale. Descriptive statistics were employed to illustrate the data and non-parametric testing (Mann-Whitney U test) was employed to test a number of hypotheses. Overall students were positive about the introduction of patient scenarios using the human patient simulator into the undergraduate nursing curriculum. This study used a small, convenience sample in one institution and therefore the results obtained cannot be generalised to nursing education before further research can be conducted with larger samples and a mixed-method research approach. However these results provide encouraging evidence to support the use of simulation within the mental health and the learning disability fields of nursing, and the development and implementation of further simulations to complement the students’ practicum.

Empathy in UK pharmacy students: assessing differences by gender, level in the degree programme, part-time employment and medical status

Background: Empathy is an important aspect of patient–healthcare professional interactions.Aims: To investigate whether gender, level in the degree programme, employment and health status affected empathy scores of undergraduate pharmacy students.Method: All undergraduate pharmacy students (n=529) at Queen’s University Belfast were invited via email to completean online validated empathy questionnaire. Empathy scores were calculated and non-parametric tests used to determine associations between factors.Results: Response rate was 60.1% (318/529) and the mean empathy score was 106.19. Scores can range from 20 to 140,with higher scores representing a greater degree of empathy. There was no significant difference between genders (p=0.211). There was a significant difference in scores across the four levels of the programme (p<0.001); scores were lowest at Level 1 and greatest at Level 4 (final year). There were no significant differences in scores for respondents who had a part-time job, a chronic condition, or took regular medication in comparison to those who did not (p=0.028,p=0.880, p=0.456, respectively).Conclusion: A reasonable level of empathy was found relative to other studies; this could be further enhanced at lower levels of the degree pathway.

Preparing to prescribe: How do clerkship students learn in the midst of complexity?

Prescribing tasks, which involve pharmacological knowledge, clinical decision-making and practical skill, take place within unpredictable social environments and involve interactions within and between endlessly changing health care teams. Despite this, curriculum designers commonly assume them to be simple to learn and perform. This research used mixed methods to explore how undergraduate medical students learn to prescribe in the 'real world'. It was informed by cognitive psychology, sociocultural theory, and systems thinking. We found that learning to prescribe occurs as a dynamic series of socially negotiated interactions within and between individuals, communities and environments. As well as a thematic analysis, we developed a framework of three conceptual spaces in which learning opportunities for prescribing occur. This illustrates a complex systems view of prescribing education and defines three major system components: the "social space", where the environmental conditions influence or bring about a learning experience; the "process space", describing what happens during the learning experience; and the intra-personal "cognitive space", where the learner may develop aspects of prescribing expertise. This conceptualisation broadens the scope of inquiry of prescribing education research by highlighting the complex interplay between individual and social dimensions of learning. This perspective is also likely to be relevant to students' learning of other clinical competencies.

Undergraduate Student perceptions of a Restorative Dentistry OSCE

Objectives: The Objective Structured Clinical Exam (OSCE) is a widely accepted assessment method in undergraduate dental education. It aims to test higher order skills, attitudes and aspects of professionalism which other summative assessments such as MCQs and other written examinations are less able to do. The aim of this study was to evaluate the perceptions of 4th year undergraduate dental students of an OSCE undertaken in the Conservation Department.
Methods: On completion of the OSCE examination 51 fourth year undergraduate students were asked to complete an anonymised questionnaire. The questionnaire was made 22 questions, and requiring the students to provide both open and closed responses.
Results: A lot of positive aspects to the OSCE were observed in responses, students felt that the OSCE was a meaningful way for assessing their clinical skills (85%), it reflected real life conditions (79%) and that it was a fair method of assessment (75%).
A number of negative aspects were also noted. Most students felt the OSCE was stressful (72%) and they felt nervous during the examination (77%). Of the undergraduates asked 42% did not feel confident doing the OSCE.
A number of students felt it would be helpful to have additional information given to them on the OSCE prior to the assessment process.
Conclusion: In general the students found the OSCE a fair, meaningful form of assessment which reflected real life clinical situations, providing them with an opportunity to show their clinical knowledge and practical skills. A number study cohort did not feel confident during the OSCE and felt nervous and stressed by the experience. The information gained from the reflective nature of the feedback questionnaire has proved invaluable in the design of subsequent diets of the OSCE examination. 

Assessing the evidence: Student response system versus computer based testing for undertaking multiple choice question assessment in undergraduate nursing education

There is a dearth of evidence focusing on student preferences for computer-based testing versus
testing via student response systems for summative assessment in undergraduate education.
This quantitative study compared the preference and acceptability of computer-based testing
and a student response system for completing multiple choice questions in undergraduate
nursing education. After using both computer-based testing and a student response system to
complete multiple choice questions, 192 first year undergraduate nursing students rated their
preferences and attitudes towards using computer-based testing and a student response system.
Results indicated that seventy four percent felt the student response system was easy to use.
Fifty six percent felt the student response system took more time than the computer-based testing
to become familiar with. Sixty Percent felt computer-based testing was more users friendly.
Seventy Percent of students would prefer to take a multiple choice question summative exam
via computer-based testing, although Fifty percent would be happy to take using student response
system. Results are useful for undergraduate educators in relation to student’s preference
for using computer-based testing or student response system to undertake a summative
multiple choice question exam

Experiences and expectations: the real reason nobody likes stats

Within undergraduate psychology courses, students often have significant levels of anxiety and negative attitudes toward the statistical element. This has been attributed to poor interaction with teachers, fears about mathematical abilities, and simply being unaware of that portion of the course or its relevance to psychology. To address this, 196 undergraduate psychology students completed a survey on statistics anxiety and attitudes. Additionally, 27 different students in similar situations took part in focus group to share their experiences of introductory statistics courses. Survey results showed that fewer than half were aware of the statistics portion of their course and that the expectation was a key factor in their experiences. Qualitative feedback from the focus groups revealed much about how the teaching may or may not improve attitudes nor decrease anxiety. Findings support various broad strategies (i.e. increase awareness of statistics in psychology and confidence in success in the course) as opposed to skill-specific (better ways of teaching probability or using games to increase participation, for example) classroom interventions to improve statistics education.

Design and Evaluation of a "Pharmacists in Schools" Community Outreach Programme: A Pilot Study.

Aims: To design, evaluate and pilot a novel programme that would allow school children to become “pharmacists for the day”,encouraging them to recognise the importance of science, to contribute to the Department of Health‟s Building the Community Partnership strategy and University Outreach to the community and to provide undergraduate pharmacy students with teaching experience and an opportunity to build their CV.

Methods: Concept and formulation development, branding work,schools visits,questionnaires and semi-structured interviews.

Results: Suitable formulations were developed and prepared by school children on visits to their schools. The children seemed to enjoy the experience and their teachers gave both positive and constructive feedback. Pharmacy undergraduate students felt they had gained valuable experience that will benefit their future careers.

Conclusion: The Pharmacists in Schools outreach programme has now been successfully piloted and launched and will now be fully implemented in 20 schools in the local community.

Determinants of academic cheating behavior: The future for accountancy in Ireland

This paper considers the potential for improving the reputation of the Irish accountancy profession by exploring undergraduate accounting students’ intolerance of academic cheating as a predictor of future attitudes to unethical workplace practices. The study reports that females are significantly more intolerant of cheating than males. Further, with regard to ethical ideology, idealism was found to have a significant positive association with intolerance of cheating while relativism reported no association. It is anticipated that the growing admission of women to professional accountancy membership together with educational intervention to increase idealism may improve ethical attitudes and help restore the profession's reputation.

The student experience in Objective Structured Clinical Examinations (OSCEs): phenomenological analysis

Background and purpose
The dominant psychometric discourse of OSCEs may lead to unexpected problems, such as a checklist-based student performance1 which under emphasises the clinical relationship with student and standardised patient (SP). Such encounters can be dehumanising for SPs2 and have implications for what students learn about relational skills through the assessment process. In this study we explore medical students’ experiences of undertaking OSCEs using a phenomenological frame.
Methodology
Interpretative phenomenological analysis is a form of qualitative methodology which has strong resonance with existentialism and focuses on the lived experience without significant reference to external political or discursive
forces.
Six 4th year undergraduate medical students from Queen’s University Belfast were recruited in December 2013. Maximum variation sampling was used. Students were interviewed by a researcher in the week prior to the
OSCE and then again in the week following the OSCE in Jan 2014. Interviews were minimally structured in order to be open to respondents, rather than adhering to a fixed topic guide, but focussed on participants’ experiences, thoughts and feelings about taking part in OSCEs. Interviews were audio-recorded and
transcribed. Students were also asked to complete a short diary entry in the days prior to the OSCEs and another immediately following. Diary entries were written, emailed or audio-recorded at student’s preference.
Results
Transcripts are currently being analysed by interpretative phenomenological analysis. Preliminary analysis has demonstrated the significance of students’ relationships within the OSCE triad (student, SP and examiner); the effect of the immediate examination environment; realism versus roleplay; students’ perceptions of the purpose of assessment; and coping mechanisms.
Full results will be available by the time of the conference.
Conclusion and Discussion
Understanding the student experience in OSCEs is a crucial step in understanding the complex construction of relationships within the OSCE triad. The focus in OSCEs is typically on standardisation and reliability, but in exploring social interactions we may refocus attention on their inherent potential for learning and effects on both students and patients.
References
1. Hodges B. Medical education and the maintenance of incompetence. Med Teach 2006;28(8):690-6
2. Johnston JL, Lundy G, McCullough M, Gormley GJ. The view from over there: reframing the OSCE through the experience of standardised patient
raters. Med Educ 2013;47(9):899-909

Can Safe Clinical Thinking be Taught?

OBJECTIVES: To determine if: (a) safe clinical decision making can be taught to undergraduate final year medical students and (b) if such students can be taught to specifically recognise illness severity from nominal clinical data. 
METHODS: 115 final year undergraduate medical students completed a 3 hour interactive Safe Thinking Workshop which focussed entirely on nontechnical skills such as potential perceptive pitfalls, attention to detail, teamwork and safe clinical decision making. The study involved students inspecting and interpreting a set of arterial blood gas results relating to a patient with acute respiratory distress, then answering a short questionnaire addressing biochemical diagnosis, clinical diagnosis and effective management. A separate question was embedded in the questionnaire to determine if astute students could determine the severity of the illness from the CO2 value provided. The study group (n = 58) completed the questionnaire immediately after the Safe Thinking Workshop, whilst the control group (n = 57) completed the questionnaire prior to the Workshop.
RESULTS: The mean total score for study students was 80.51%, with a mean total score of 63.86% for the control group (Student’s t-test; p<0.05). Correct classification of illness severity was observed in 10.35% of study students, compared with 3.51% of control students (p<0.05). 
CONCLUSION: These results suggest that safe clinical decision making and recognition of illness severity can be fostered by specific teaching in the nontechnical skill areas described above.

Evaluation of Video Presentation to Deliver Surgical Anatomy Teaching

Title Evaluation of Video Presentation to Deliver Surgical Anatomy Teaching

Authors Walsh I.K., Boohan M., Dorman A.

Objectives To evaluate the efficacy of newly introduced video presentation to deliver Surgical Anatomy teaching to undergraduate medical students.

Design and Setting Qualitative and quantitative study using questionnaires and focus groups, employing students undertaking the perioperative medicine module of the phase 4 undergraduate medical curriculum at Queen’s University Belfast.

Outcome Measures To determine:
(1) if video presentation is effective in delivering surgical anatomy teaching,
(2) student’s learning preferences regarding this teaching method.
Results The questionnaire response rate was 89% (216 of 244 students; female: male ratio 1.25) and 42 students participated in 6 focus groups. Mean questionnaire responses indicated a favourable opinion on quality assurance items, with a mixed response to video presentation as a learning method. 71% of students preferred to receive a lecture in person, rather than via video presentation. There were no statistically significant differences between genders regarding learning preferences in general and regarding video versus live presentation in particular. Exploratory factor analysis demonstrated that favourable responses to video presentation were strongly associated with perceived audiovisual quality and learning preferences (Cronbach’s alpha coefficient 0.77), with 72% of students considering video presentation worthwhile. Positive perception of overall quality was strongly associated with learning preferences as well as more generic quality assurance issues (80% students; alpha coefficient 0.83).
The results were supported by triangulation of the above quantitative data with qualitative data generated by the focus groups. Students further articulated the view that video presentation may be more appropriate and effective in a mixed method setting.

Reference Basu Roy R, McMahon GT. Video-based cases disrupt deep critical thinking in problem-based learning. Med Educ 2012 Apr;46(4):426-435.