A qualitative analysis of reflection in undergraduate and graduate programs

The purpose ofthis study was to explore various types ofreflection and to explore reflection on action, reflection as a practice, and reflection as a process. In doing this, the intent was to discover the perceived benefits of reflection in the classroom and to provide guidelines for future use at the undergraduate and graduate level. The qualitative components in this study included the data collection strategy of semistructured interviews with 2 undergraduate students, 2 graduate students, 1 undergraduate studies professor, and 1 graduate studies professor. The data analysis strategies included a within-case analysis and a cross-case analysis. Through the interviews participants discussed their experiences with the use ofreflection in the classroom. Through the completion ofthis analysis the researcher expected to discover the benefits ofreflection at this level of education, as well as provide suggestions for future use. Both undergraduate and graduate students and professors were found to benefit from the use of reflection in the classroom. The use ofreflection in the undergraduate and graduate classroom was found to improve student/teacher and student/peer relationships, foster critical thinking, allow for connections between learned theory and life experience, and improve students' writing abilities. Based on the results ofthe study the implications ofreflection for the undergraduate and graduate classroom and for further research are provided.

An electronic portfolio for quantitative assessment of surgical skills in undergraduate medical education.

BACKGROUND We evaluated a newly designed electronic portfolio (e-Portfolio) that provided quantitative evaluation of surgical skills. Medical students at the University of Seville used the e-Portfolio on a voluntary basis for evaluation of their performance in undergraduate surgical subjects. METHODS Our new web-based e-Portfolio was designed to evaluate surgical practical knowledge and skills targets. Students recorded each activity on a form, attached evidence, and added their reflections. Students self-assessed their practical knowledge using qualitative criteria (yes/no), and graded their skills according to complexity (basic/advanced) and participation (observer/assistant/independent). A numerical value was assigned to each activity, and the values of all activities were summated to obtain the total score. The application automatically displayed quantitative feedback. We performed qualitative evaluation of the perceived usefulness of the e-Portfolio and quantitative evaluation of the targets achieved. RESULTS Thirty-seven of 112 students (33%) used the e-Portfolio, of which 87% reported that they understood the methodology of the portfolio. All students reported an improved understanding of their learning objectives resulting from the numerical visualization of progress, all students reported that the quantitative feedback encouraged their learning, and 79% of students felt that their teachers were more available because they were using the e-Portfolio. Only 51.3% of students reported that the reflective aspects of learning were useful. Individual students achieved a maximum of 65% of the total targets and 87% of the skills targets. The mean total score was 345 ± 38 points. For basic skills, 92% of students achieved the maximum score for participation as an independent operator, and all achieved the maximum scores for participation as an observer and assistant. For complex skills, 62% of students achieved the maximum score for participation as an independent operator, and 98% achieved the maximum scores for participation as an observer or assistant. CONCLUSIONS Medical students reported that use of an electronic portfolio that provided quantitative feedback on their progress was useful when the number and complexity of targets were appropriate, but not when the portfolio offered only formative evaluations based on reflection. Students felt that use of the e-Portfolio guided their learning process by indicating knowledge gaps to themselves and teachers.

An electronic portfolio for quantitative assessment of surgical skills in undergraduate medical education.

BACKGROUND We evaluated a newly designed electronic portfolio (e-Portfolio) that provided quantitative evaluation of surgical skills. Medical students at the University of Seville used the e-Portfolio on a voluntary basis for evaluation of their performance in undergraduate surgical subjects. METHODS Our new web-based e-Portfolio was designed to evaluate surgical practical knowledge and skills targets. Students recorded each activity on a form, attached evidence, and added their reflections. Students self-assessed their practical knowledge using qualitative criteria (yes/no), and graded their skills according to complexity (basic/advanced) and participation (observer/assistant/independent). A numerical value was assigned to each activity, and the values of all activities were summated to obtain the total score. The application automatically displayed quantitative feedback. We performed qualitative evaluation of the perceived usefulness of the e-Portfolio and quantitative evaluation of the targets achieved. RESULTS Thirty-seven of 112 students (33%) used the e-Portfolio, of which 87% reported that they understood the methodology of the portfolio. All students reported an improved understanding of their learning objectives resulting from the numerical visualization of progress, all students reported that the quantitative feedback encouraged their learning, and 79% of students felt that their teachers were more available because they were using the e-Portfolio. Only 51.3% of students reported that the reflective aspects of learning were useful. Individual students achieved a maximum of 65% of the total targets and 87% of the skills targets. The mean total score was 345 ± 38 points. For basic skills, 92% of students achieved the maximum score for participation as an independent operator, and all achieved the maximum scores for participation as an observer and assistant. For complex skills, 62% of students achieved the maximum score for participation as an independent operator, and 98% achieved the maximum scores for participation as an observer or assistant. CONCLUSIONS Medical students reported that use of an electronic portfolio that provided quantitative feedback on their progress was useful when the number and complexity of targets were appropriate, but not when the portfolio offered only formative evaluations based on reflection. Students felt that use of the e-Portfolio guided their learning process by indicating knowledge gaps to themselves and teachers.

Dialogue journal writing: a tool for critical reflection in the adult ESL learner

This study attempted to determine whether or not dialogue journal writing encouraged critical reflection in the adult ESL (English as a Second Language) learner. According to research in adult education and anecdotal evidence, the process ofdialogue journal writing can facilitate critical reflection in the adult learner. However, little research has been conducted to examine whether or not journal writing can facilitate critical reflection in the second language learner. As a result, ten low-intermediate level adult ESL students from Brock University's Intensive English Language Programme participated in a dialogue journal writing programme in their writing class. The participants wrote journal entries over a 10-week period, and were interviewed once throughout the process to determine their perceptions ofthe journal writing experience. They also were observed by the researcher throughout the journal writing sessions to establish whether any behaviours or intrusions might affect the participants' writing processes. After the content ofthe journals and the interviews, and the observations made by the researcher were analysed, it was confirmed that, for these participants, dialogue journal writing did not necessarily encourage critical reflection. Moreover, the participants' perceptions ofjournal writing were that it helped them to practise the syntax, vocabulary, and rhetorical patterns ofEnglish; nevertheless, it did not foster critical reflection or thinking.

Valuing and encouraging critical reflection in pre-service teacher education

This qualitative study was designed to investigate aspects related to valuing and encouraging critical reflection in pre-service teacher education. An examination of the place and function of practicum logbooks as used at Covenant Canadian Reformed Teachers' College, a small private college which offers pre-service teacher education formed the core of the research. An analysis of the practicum logbooks written by five student teachers during three different practicum placements was performed at two levels. First, a content analysis served to identify general and specific categories within the practice teaching contextas a learning experience. Secondly, in-depth intuitive and thematic analyses of the entries which related specifically to reflection as a learning experience gave rise to critical questions. Throughout the process, the five participants formed an active and involved group of co-researchers, adding their voices to the narrative of the learning experience. Variables such as personality type, learning style and self-directedness added a dimension which deepened and emiched the study. The result of the study suggests that practicum logbooks form a valuable base for valuing and encouraging critical reflection in pre-service teacher education. The results also suggest that not all students appear to be equally capable of critical reflection. Recognizing that teacher education exists as a continuum appears to support the findings that in their journey along this continuum, student teachers not only move from reflection-on-action to reflection-in-action, but also from content to process to premise reflection. An awareness of contributing factors such as personality type, degree of risk-taking, preferred learning style and self-directedness on the part of teacher-educators will serve to create a climate of trust in which student teachers can safely develop critical reflection, using practicum logbooks as one possible medium.

Teaching of the Integrated Management of Childhood Illness strategy in undergraduate nursing programs

Objective: To describe and analyze the teaching of the Integrated Management of hildhood Illness (IMCI) strategy on Brazilian undergraduate nursing programs. Method: Integrating an international multicentric study, a cross-sectional online survey was conducted between May and October 2010 with 571 undergraduate nursing programs in Brazil Results: Responses were received from 142 programs, 75% private and 25% public. 64% of them included the IMCI strategy in the theoretical content, and 50% of the programs included IMCI as part of the students’ practical experience. The locations most used for practical teaching were primary health care units. The ‘treatment’ module was taught by the fewest number of programs, and few programs had access to the IMCI instructional manuals. All programs used exams for evaluation, and private institutions were more likely to include class participation as part of the evaluation. Teaching staff in public institutions were more likely to have received training in teaching IMCI. Conclusion: In spite of the relevance of the IMCI strategy in care of the child, its content is not addressed in all undergraduate programs in Brazil, and many programs do not have access to the IMCI teaching manuals and have not provide training in IMCI to their teaching staff.

A model for the integration of legal research into Australian undergraduate law curricula

The marginalisation of the teaching and learning of legal research in the Australian law school curriculum is, in the author's experience, a condition common to many law schools. This is reflected in the reluctance of some law teachers to include legal research skills in the substantive law teaching schedule — often the result of unwillingness on the part of law school administrators to provide the resources necessary to ensure that such integration does not place a disproportionately heavy burden of assessment on those who are tempted. However, this may only be one of many reasons for the marginalisation of legal research in the law school experience. Rather than analyse the reasons for this marginalisation, this article deals with what needs to be done to rectify the situation, and to ensure that the teaching of legal research can be integrated into the law school curriculum in a meaningful way. This requires the use of teaching and learning theory which focuses on student-centred learning. This article outlines a model of legal research. It incorporates five transparent stages which are: analysis, contextualisation, bibliographic skills, interpretation and assessment and application.

Improving learning in undergraduate control engineering courses using context-based learning models

Control Engineering is an essential part of university electrical engineering education. Normally, a control course requires considerable mathematical as well as engineering knowledge and is consequently regarded as a difficult course by many undergraduate students. From the academic point of view, how to help the students to improve their learning of the control engineering knowledge is therefore an important task which requires careful planning and innovative teaching methods. Traditionally, the didactic teaching approach has been used to teach the students the concepts needed to solve control problems. This approach is commonly adopted in many mathematics intensive courses; however it generally lacks reflection from the students to improve their learning. This paper addresses the practice of action learning and context-based learning models in teaching university control courses. This context-based approach has been practised in teaching several control engineering courses in a university with promising results, particularly in view of student learning performances.

Evaluation of creative problem solving abilities in undergraduate structural engineers through interdisciplinary problem based learning

For a structural engineer, effective communication and interaction with architects cannot be underestimated as a key skill to success throughout their professional career. Structural engineers and architects have to share a common language and understanding of each other in order to achieve the most desirable architectural and structural designs. This interaction and engagement develops during their professional career but needs to be nurtured during their undergraduate studies. The objective of this paper is to present the strategies employed to engage higher order thinking in structural engineering students in order to help them solve complex problem-based learning (PBL) design scenarios presented by architecture students. The strategies employed were applied in the experimental setting of an undergraduate module in structural engineering at Queen’s University Belfast in the UK. The strategies employed were active learning to engage with content knowledge, the use of physical conceptual structural models to reinforce key concepts and finally, reinforcing the need for hand sketching of ideas to promote higher order problem-solving. The strategies employed were evaluated through student survey, student feedback and module facilitator (this author) reflection. The strategies were qualitatively perceived by the tutor and quantitatively evaluated by students in a cross-sectional study to help interaction with the architecture students, aid interdisciplinary learning and help students creatively solve problems (through higher order thinking). The students clearly enjoyed this module and in particular interacting with structural engineering tutors and students from another discipline

Unpacking insanity defence standards: an experimental study of rationality and control tests in criminal law

The present study investigated the impact of different legal standards on mock juror decisions concerning whether a defendant was guilty or not guilty by reason of insanity. Undergraduate students (N = 477) read a simulated case summary involving a murder case and were asked to make an insanity determination. The cases differed in terms of the condition of the defendant (rationality deficit or control deficit) and the legal standard given to the jurors to make the determination (Model Penal Code, McNaughten or McNaughten plus a separate control determination). The effects of these variables on the insanity determination were investigated. Jurors also completed questionnaires measuring individualism and hierarchy attitudes and perceptions of facts in the case. Results indicate that under current insanity standards jurors do not distinguish between defendants with rationality deficits and defendants with control deficits regardless of whether the legal standard requires them to do so. Even defendants who lacked control were found guilty at equal rates under a legal standard excusing rationality deficits only and a legal standard excluding control and rationality deficits. This was improved by adding a control test as a partial defence, to be determined after a rationality determination. Implications for the insanity defence in the Criminal Justice System are discussed.

Evaluating curriculum changes in undergraduate cancer education

Background. Previous studies have indicated that Australian medical schools have not adequately prepared our graduating doctors to care for patients with cancer. The University of Western Australia (UWA) introduced a two-week clinical attachment in cancer medicine for fifth-year students in 2000 and a four-day clinical attachment in palliative care for sixth-year students in 2001. This article evaluates the introduction of these dedicated clinical attachments in cancer and palliative care. Method. The Australian Cancer Society's Cancer Education Survey was administered to the UWA graduates starting their intern year in teaching hospitals in Perth, Western Australia, in 2002. Their responses were compared with data collected in a similar national survey of Australian and New Zealand interns in 2001. Results. The response rate was 56% (n = 70). When compared with the national data for 2001, more UWA interns (2002) would refer a newly diagnosed breast cancer patient to a multidisciplinary breast clinic (97% vs. 74%, P<.001). Fewer UWA 2002 interns rated their training as poor or very poor in the management of patients with incurable cancer (19% vs. 35%, P=.008) and the management of symptoms in patients dying from cancer (10% vs. 37%, P<.001), but they were more likely to rate their training in assisting a patient to stop smoking as poor or very poor (54% vs. 21%, P<.001). Only a quarter of the UWA 2002 interns had examined a patient with a cancer of the mouth or tongue (25% vs. 49%, P<.001), and only two thirds had examined a patient with lymphoma (64% vs. 83%, P<.001). Conclusions. Our data reflect changes in the final two years of the medical course at UWA and suggest that the introduction of dedicated attachments in cancer and palliative care has better prepared graduating doctors to care for patients with cancer.