Measuring critical thinking skills and dispositions in undergraduate students

This thesis investigates critical thinking with a particular focus on measurement in undergraduate students. A higher education context was chosen because many regard critical thinking development as a primary goal for third level education. Nine studies, both cross-sectional and longitudinal in design, were conducted with undergraduate psychology students (N=387), using the California Critical Thinking Disposition Inventory (CCTDI) and the California Critical Thinking Skills Test (CCTST). Studies 1-3 revealed psychometric weaknesses in the CCTDI and revised the scale with factor analysis and reliability analysis to form the CCTDI United Kingdom revision (CCTDI-UK). Study 4 investigated convergent validity and showed significant inter-correlation between the sub-scales of the CCTDI-UK, and significant correlations with the Openness scale of the NEO Personality Inventory (NEO PI-R). The study also provided evidence for improvement in scores on three of the six sub-scales in the CCTDI-UK (Truth-Seeking, Inquisitiveness, Open-Mindedness) during the course of an undergraduate degree. Study 5 explored a two factor structure for critical thinking dispositions. Study 6 used reliability analysis to revise the CCTST to produce the CCTST-UK. Study 7 showed that the CCTST-UK had a moderate correlation with degree attainment and a slightly higher correlation with a test of non-verbal intelligence (Raven’s Advanced Progressive Matrices short form); in addition, the study showed that scores on the CCTST-UK improved during the course of the degree. Studies 8 and 9 investigated the potential of critical thinking for predicting degree attainment. A-levels predicted approximately 10% of the variance of degree attainment while entry level scores on the CCTST-UK predicted an additional 5%. Exit level scores on the CCTST-UK and the Inquisitive sub-scale of the CCTDI-UK were found to be predictors of degree attainment The main conclusions of the thesis were that these tests had significant potential for predicting degree attainment and that they measured a substantial proportion of the theoretical constructs identified by the major authors in critical thinking.

Mental illness or mental distress; stigma and concealment in University students - a discussion paper

This discussion paper addresses the issue of mental distress, sometimes mis- perceived or misinterpreted as mental illness. The
focus is on positive psychology. Reflecting in part on a UK-based study with younger University students studying to health
related degrees, nursing, midwifery and medicine (N = 12), many of the students were apparently suffering dis-stress with
disordered eating at least in part being used as a coping mechanism. However notwithstanding that they were at the end of
their first year studies in health, a significant number of the students interpreted their approach to eating as a mental illness.
Consequently, many within the study felt stigmatised and were reluctant to acknowledge certainly to the University health care
authorities that there was an issue; perceiving both academic and career/professional consequences of mental health labelling. The
paper approaches the issue of mental health from a health promoting perspective, reflecting against the theory of salutogenesis
and its focus within the three dimensions of comprehensibility, manageability and meaningfulness as an approach to building
resilience and managing stressors to better facilitate a sense of coherence. Complex manifestations of distress and poor coping
mechanisms can in some cases be misinterpreted or miss perceived as mental illness. Promoting mental health and reducing the
stigma of mental illness or the misperception of mental distress as mental illness, would need to be addressed in order to more
effectively outreach certainly to younger University students who might be at risk. The focus should be on how better to promote
their sense of coherence.

Preparing to prescribe: How do clerkship students learn in the midst of complexity?

Prescribing tasks, which involve pharmacological knowledge, clinical decision-making and practical skill, take place within unpredictable social environments and involve interactions within and between endlessly changing health care teams. Despite this, curriculum designers commonly assume them to be simple to learn and perform. This research used mixed methods to explore how undergraduate medical students learn to prescribe in the 'real world'. It was informed by cognitive psychology, sociocultural theory, and systems thinking. We found that learning to prescribe occurs as a dynamic series of socially negotiated interactions within and between individuals, communities and environments. As well as a thematic analysis, we developed a framework of three conceptual spaces in which learning opportunities for prescribing occur. This illustrates a complex systems view of prescribing education and defines three major system components: the "social space", where the environmental conditions influence or bring about a learning experience; the "process space", describing what happens during the learning experience; and the intra-personal "cognitive space", where the learner may develop aspects of prescribing expertise. This conceptualisation broadens the scope of inquiry of prescribing education research by highlighting the complex interplay between individual and social dimensions of learning. This perspective is also likely to be relevant to students' learning of other clinical competencies.

Maths anxiety in psychology undergraduates: A mixed-methods approach to formulating and implementing interventions

A key challenge to educators in disciplines that, while not maths based, nevertheless
contain some maths component, is mathematics anxiety. Over the years, a number of
intervention strategies have been tested, seeking reduce maths anxiety in undergraduates.
Many of these studies, however, contain methodological issues that challenge their validity. It
is also unclear how many of these studies decide which type of interventions to use. This
research sought to correct both of these issues. In Study 1, focus groups were carried out to
explore which interventions students believed would most likely reduce their maths anxiety.
Study 2 implemented those interventions that Study 1 showed to be practical and potentially
effective, utilising a large sample of Year 1 and Year 2 psychology undergraduates,
controlling for potential methodological confounds. Results showed that only one
intervention (teaching quantitative research methods using real-life examples) had any
significant effect on maths anxiety, and this was slight. These results, while not impressive by
themselves, do suggest ways in which larger-scale interventions could seek to proceed in
terms of reducing maths anxiety.

An evaluation of the Socrative (personal response system) app for increasing student engagement and learning in an undergraduate psychology curriculum.

Personal response systems using hardware such as 'clickers' have been around for some time, however their use is often restricted to multiple choice questions (MCQs) and they are therefore used as a summative assessment tool for the individual student. More recent innovations such as 'Socrative' have removed the need for specialist hardware, instead utilising web-based technology and devices common to students, such as smartphones, tablets and laptops. While improving the potential for use in larger classrooms, this also creates the opportunity to pose more engaging open-response questions to students who can 'text in' their thoughts on questions posed in class. This poster will present two applications of the Socrative system in an undergraduate psychology curriculum which aimed to encourage interactive engagement with course content using real-time student responses and lecturer feedback. Data is currently being collected and result will be presented at the conference.
The first application used Socrative to pose MCQs at the end of two modules (a level one Statistics module and level two Individual Differences Psychology module, class size N≈100), with the intention of helping students assess their knowledge of the course. They were asked to rate their self-perceived knowledge of the course on a five-point Likert scale before and after completing the MCQs, as well as their views on the value of the revision session and any issues that had with using the app. The online MCQs remained open between the lecture and the exam, allowing students to revisit the questions at any time during their revision.
This poster will present data regarding the usefulness of the revision MCQs, the metacognitive effect of the MCQs on student's judgements of learning (pre vs post MCQ testing), as well as student engagement with the MCQs between the revision session and the examination. Student opinions on the use of the Socrative system in class will also be discussed.
The second application used Socrative to facilitate a flipped classroom lecture on a level two 'Conceptual Issues in Psychology' module, class size N≈100). The content of this module requires students to think critically about historical and contemporary conceptual issues in psychology and the philosophy of science. Students traditionally struggle with this module due to the emphasis on critical thinking skills, rather than simply the retention of concrete knowledge. To prepare students for the written examination, a flipped classroom lecture was held at the end of the semester. Students were asked to revise their knowledge of a particular area of Psychology by assigned reading, and were told that the flipped lecture would involve them thinking critically about the conceptual issues found in this area. They were informed that questions would be posed by the lecturer in class, and that they would be asked to post their thoughts using the Socrative app for a class discussion. The level of preparation students engaged in for the flipped lecture was measured, as well as qualitative opinions on the usefulness of the session. This poster will discuss the level of student engagement with the flipped lecture, both in terms of preparation for the lecture, and engagement with questions posed during the lecture, as well as the lecturer's experience in facilitating the flipped classroom using the Socrative platform.

Students’ engagement in school, achievement goals and grade level: A literature review

Este E-Book reúne um conjunto de investigações apresentadas no “I Congresso Internacional Envolvimento dos Alunos na Escola: Perspetivas da Psicologia e Educação” (ICIEAE), organizado no âmbito do “Projeto PTDC/CPE-CED/114362/2009 - Envolvimento dos Alunos na Escola: Diferenciação e Promoção” (EAE-DP), financiado pela Fundação para a Ciência e a Tecnologia (FCT).

Students’ engagement in school and peer relations: A literature review

Este E-Book reúne um conjunto de investigações apresentadas no “I Congresso Internacional Envolvimento dos Alunos na Escola: Perspetivas da Psicologia e Educação” (ICIEAE), organizado no âmbito do “Projeto PTDC/CPE-CED/114362/2009 - Envolvimento dos Alunos na Escola: Diferenciação e Promoção” (EAE-DP), financiado pela Fundação para a Ciência e a Tecnologia (FCT).

Enhancing Student Learning Experiences in Sport Psychology Modules Using Practical Activities

The University of Worcester states in its most recent strategic plan (2013 – 2018) a set of enduring values that guide and direct the activities of the institution. The first listed, and perhaps the most important value is the striving to be “an outstanding university at which to be a student”. This is further supplemented by values such as “to inspire our students to reach their full potential through excellent, innovative teaching, scholarship and research” (University of Worcester 2013: p.4). One of the many ways in which the institution strives to provide this outstanding educational experience is through regular engagement, both formal and informal, with students at a number of points in each semester. Regular experiences of collating formal and informal feedback has led to the identification of a common theme amongst Higher National Diploma (HND) students in the Institute of Sport and Exercise Sciences (ISES), where they consistently request ‘more practicals’. The ISES modules however are designed to incorporate a high degree of interaction, practical activities and tasks. This is especially important for those studying at HND level as research suggests differences in learning preferences exist when compared to undergraduate students, the former preferring a more tactile style of learning (Peters et al. 2008). Using an introductory Sport Psychology HND module as an example, practical activities and tasks are fully embedded in the taught sessions to enable contextual links to be made between the learning outcomes and their subsequent use. Examples of these include: a. interviewing athletes to produce a performance profile (Butler & Hardy 1992); b. completing psychometric instruments such as the Competitive State Anxiety Inventory-2 (CSAI-2) to measure competitive anxiety in sport (Martens et al. 1990) and demonstrate data collection and construct measurement; c. performing relaxation interventions on the students to demonstrate how specific techniques (in this instance, decreasing somatic anxiety) might work in practice; d. demonstrating how observational learning facilitates skill acquisition by creating experimental conditions that the students participate in, in teaching a new skill. Nevertheless owing to the students' previously stated on-going requests for more practical activities, it became evident that assumptions about what students consider an effective means of experiential or active learning in the context of sport-related disciplines of study needed to be investigated. This is where the opportunity to undertake an action research project arose, this being a practical method commonly employed in pedagogical enquiry to aid reflection on teaching and assessment practice for the purposes of working towards continuous improvement.

Students who self-harm: coping style, rumination and alexithymia

Counsellors working with students or other young adults may encounter individuals who have self-harmed, either with suicidal or non-suicidal intent. Recent US studies reported rates of self-injury of up to 37% of the student population, but studies in the UK have focussed primarily on younger adolescents. This study examined reported self-harm incidents (scratching, cutting, poisoning, overdose etc) from a sample of 617 university students. A total of 27% reported at least one incident of self-harm, with almost 10% having harmed themselves while at university. Gender differences were not significant but psychology students reported significantly more self-harm than other students. Participants reporting self-harm scored significantly higher on maladaptive coping styles, rumination, and alexithymia (specifically difficulty in identifying emotions) and these differences were most marked for students reporting repetitive and recent self-harm. Rumination and Alexithymia factor 1 (difficulty identifying feelings) emerged as the most robust factors predicting self-harm status. Comments from students who self-harmed at university highlighted the importance of accessible services and academic staff support. The implications of these findings for counselling interventions are discussed, including challenging negative rumination tendencies and developing mindfulness skills.

Training medical students to conduct motivational interviewing: a randomized controlled trial.

OBJECTIVE: To examine the effectiveness of motivational interviewing (MI) training among medical students. METHODS: All students (n=131) (year 5) at Lausanne Medical School, Switzerland were randomized into an experimental or a control group. After a training in basic communication skills (control condition), an 8-h MI training was completed by 84.8% students in the exprimental group. One week later, students in both groups were invited to meet with two standardized patients. MI skills were coded by blinded research assistants using the Motivational Interviewing Treatment Integrity 3.0. RESULTS: Superior MI performance was shown for trained versus control students, as demonstrated by higher scores for "Empathy" [p<0.001] and "MI Spirit" [p<0.001]. Scores were similar between groups for "Direction", indicating that students in both groups invited the patient to talk about behavior change. Behavior counts assessment demonstrated better performance in MI in trained versus untrained students regarding occurences of MI-adherent behavior [p<0.001], MI non-adherent behavior [p<0.001], Closed questions [p<0.001], Open questions [p=0.001], simple reflections [p=0.03], and Complex reflections [p<0.001]. Occurrences were similar between groups regarding "Giving information". CONCLUSION: An 8-h training workshop was associated with improved MI performance. PRACTICE IMPLICATIONS: These findings lend support for the implementation of MI training in medical schools.

Helping medical students to acquire a deeper understanding of truth-telling.

PROBLEM: Truth-telling is an important component of respect for patients' self-determination, but in the context of breaking bad news, it is also a distressing and difficult task. INTERVENTION: We investigated the long-term influence of a simulated patient-based teaching intervention, integrating learning objectives in communication skills and ethics into students' attitudes and concerns regarding truth-telling. We followed two cohorts of medical students from the preclinical third year to their clinical rotations (fifth year). Open-ended responses were analysed to explore medical students' reported difficulties in breaking bad news. CONTEXT: This intervention was implemented during the last preclinical year of a problem-based medical curriculum, in collaboration between the doctor-patient communication and ethics programs. OUTCOME: Over time, concerns such as empathy and truthfulness shifted from a personal to a relational focus. Whereas 'truthfulness' was a concern for the content of the message, 'truth-telling' included concerns on how information was communicated and how realistically it was received. Truth-telling required empathy, adaptation to the patient, and appropriate management of emotions, both for the patient's welfare and for a realistic understanding of the situation. LESSONS LEARNED: Our study confirms that an intervention confronting students with a realistic situation succeeds in making them more aware of the real issues of truth-telling. Medical students deepened their reflection over time, acquiring a deeper understanding of the relational dimension of values such as truth-telling, and honing their view of empathy.

Exploring the events that engage graduate students in transformative learning /

This research explored the events that engaged graduate students in transformative learning within a graduate program in education. This context was chosen because one objective of a graduate program is to facilitate critical thinking and transformative learning. The question ofhow adult learners perceive and experience learning steered the direction ofthis study. However, the purpose ofthis research was to study critical incidents that led to profound cognitive and affective changes as perceived by the graduate students. Specifically, the questions to be answered were what critical incidents happened to graduate students while in the Master ofEducation program, how were the incidents experienced, and what transformation resulted? The research design evolved over the course of a year and was highly influenced by previous empirical studies and criticisms oftransformative learning theory. The overall design was qualitative and phenomenological. A critical and interpretive approach was made to empirical data collected through a critical incident questionnaire and in-depth interviews. Inductive analysis allowed theory to be built from the data by making comparisons. New questions emerged and attention was given to social context, the passage oftime, and sequence ofevents in order to give meaning and translation ofthe participants' experiences and to build the interpretive narratives. Deductive analysis was also used on the data and a blending ofthe two forms of analysis; this resulted in the development ofa foundational model for transformative learning to be built.The data revealed critical incidents outside ofthe graduate school program that occurred in childhood or adult life prior to graduate school. Since context of individuals' lives had been an important critique of past transformative learning models and studies, this research expanded the original boundaries of this study beyond graduate school to incorporate incidents that occurred outside of graduate school. Critical incidents were categorized into time-related, people-related, and circumstancerelated themes. It was clear that participants were influenced and molded by the stage oftheir life, personal experiences, familial and cultural conditioning, and even historic events. The model developed in this document fiom an overview ofthe fmdings identifies a four-stage process of life difficulty, disintegration, reintegration, and completion that all participants' followed. The blended analysis was revealed from the description ofhow the incidents were experienced by the participants. The final categories were what were the feelings, what was happening, and what was the enviromnent? The resulting transformation was initially only going to consider cognitive and affective changes, however, it was apparent that contextual changes also occurred for all participants, so this category was also included. The model was described with the construction metaphor of a building "foimdation" to illustrate the variety of conditions that are necessary for transformative learning to occur. Since this was an exploratory study, no prior models or processes were used in data analysis, however, it appeared that the model developed from this study incorporated existing models and provided a more encompassing life picture oftransformative learning.

An after-school literacy program : investigating the experiences of students with literacy difficulties, their volunteer tutors, and the tutors' transition into the teaching profession

This research responds to a pervasive call for our educational institutions to provide students with literacy skills, and teachers with the instructional supports necessary to facilitate this skill acquisition. Questions were posed to gain information concerning the efficacy ofteaching literacy strategies to students with learning difficulties, the impact of this training on their volunteer tutors, and the influence of this experience on these tutors' ensuing instructional practice as teacher candidates in a preservice education program. Study #1 compared a nontreatment group of students with literacy difficulties who participated in the program and found that program participants were superior at reading letter patterns and at comprehending the elements of story grammar. Concurrently, the second study explored the experiences of 19 volunteer tutors and uncovered that they acquired instructional skills as they established a knowledge base in teaching reading and writing, and they affirmed personal goals to become future teachers. Study #3 tracked 6 volunteer tutors into their pre-service year and identified their constructions, and beliefs about literacy instruction. These teacher candidates discussed how they had intended to teach reading and writing strategies based on their position that effective teaching ofthese skills in the primary grades is integral to academic success. The teacher candidates emphasized the need to build rapport with students, and the need to exercise flexibility in lesson plan delivery while including activities to meet emotional and developmental requirements of students. The teacher candidates entered their pre-service education with an initial cognition set based on the limited teaching context of tutoring. This foundational ii perception represented their prior knowledge of literacy instruction, a perception that appeared untenable once they were immersed in a regular instructional setting. This disparity provoked some of the teacher candidates to denounce their teacher mentors for not consistently employing literacy strategies and individualized instruction. This critical perspective could have been a demonstration of cognitive dissonance. In the end, when the teacher candidates began to look toward the future and how they would manage the demands of an inclusive classroom, they recognized the differences in the contexts. With an appreciation for the need for balance between prior and present knowledge, the teacher candidates remained committed to implementing their tutoring strategies in future teaching positions. This document highlights the need for teacher candidates with instructional experience prior to teacher education, to engage in cognitive negotiations to assimilate newly acquired pedagogies into existing pedagogies.

Bridging the gap between post-secondary students with disabilities and faculty members with their perceptions of access and accommodation

The purpose of this study was to identify factors related to successful university course completion for students with disAbilities including the knowledge that faculty members and students with disAbilities have about accommodation issues; the accommodations that students with disAbilities and faculty use and find effective in the university setting; faculty members' perceptions of and attitudes toward students with disAbilities; and the attitudes that students with disAbilities have toward faculty. Fiftyseven participants were involved in the research, eight students with disabilities and forty-nine faculty members. The main objective of the research was to describe how the skills, knowledge, and attitudes of students and faculty members, and organizational supports interact to support students' academic success. The utilization and effectiveness of accommodations to overcome barriers associated with disAbility in a post-secondary setting are described in relation to students' and faculty members' perceptions of academic success.