Opintojaksopalautejärjestelmän kehittäminen ammattikorkeakoululle

Koulutusorganisaatio on nykypäivänä samanlaisten haasteiden edessä kuin liike-elämä. Se joutuu kilpailemaan julkisista resursseista ja hyvistä opiskelijoista. Menestyäkseen tässä kilpailussa organisaation on kehitettävä toimintansa laatua jatkuvasti. Tärkein koulussa tapahtuva toiminto on oppiminen ja oppimisen laatu perustuu koulutusorganisaation laatuun. Tämän diplomityön tavoitteena oli kehittää toimiva opintojaksopalautejärjestelmä Saimaan ammattikorkeakoululle. Palautejärjestelmä on tärkeä osa oppivan organisaation laatujärjestelmää. Työssä tutkittiin aluksi millainen on oppiva organisaatio, miten se oppii ja millaisia vaatimuksia palautejärjestelmään kohdistuu oppivan organisaation ja laatujärjestelmän näkö-kulmasta. Empiirisessä osassa selvitettiin aluksi teemahaastattelujen avulla opiskelijoiden ja opetushenkilöstön näkemyksiä nykyisistä menettelytavoista ja toiveista uuden järjestelmän suhteen. Haastattelujen, kohdeorganisaation nykytilan ja vertailujärjestelmien analysoinnin perusteella suunniteltiin uusi yhteinen palautejärjestelmä nykyisten vaihtelevien palautekäytäntöjen tilalle. Johdon hyväksymä palautejärjestelmä otettiin käyttöön suunnistellusti vuoden 2008 lopulla. Palaute ja seuranta palvelevat organisaation oppimista silloin, kun sekä oppimisesta että opettamisesta kerätään palautetta, palautetta saadaan kattavasti, se viedään toimenpiteiden tasolle ja kaikesta tästä tiedotetaan asianosaisille.

A universally delivered CBT based intervention in a Scottish secondary school: a pilot feasibility study

Objectives: To evaluate the feasibility of a universally delivered CBT-based programme for pupils within a Scottish secondary school setting. Design: A pre-post, within and between groups design was utilised. Setting: Religious Moral Citizenship and Education (RMCE) classes in a Scottish secondary school. Participants: Four (n = 103) classes of third year secondary school pupils were arbitrarily allocated to two conditions: RMCE-as usual (RMCE-AU) controls, and LLTTF intervention. Intervention: Living Life to the Full (LLTTF) is a series of Cognitive Behavioural Therapy (CBT)-based booklets and accompanying 8 classes to improve coping skills. An adolescent version of LLTTF was recently developed. This was delivered over nine weeks by school teachers trained in the approach. Outcome measures: The Strengths and Difficulties Questionnaire, Rosenberg Self-Esteem scale, General Self-Efficacy Scale, and Locus of Control scale were administered at baseline and 9 week follow-up. To determine acceptability and utility of the materials course feedback was gathered weekly from the intervention group and a focus group (n=5) was conducted at 3 month follow up. Results: Outcome measures showed no significant improvement in overall wellbeing of those in the intervention group compared with that of the control group. Weekly feedback suggested that the majority of pupils found the materials useful and relevant. Focus group feedback suggested that pupils found the intervention useful, had utilised strategies in everyday life and would welcome recurring provision of such interventions within the school setting. Conclusions: Universally delivered CBT intervention is acceptable and feasible within the secondary school environment. However, objective measurement using standardised tools does not adequately corroborate qualitative feedback from pupils. Issues relating to measurement, study design and implementation of future interventions are discussed.

Medical residents' feedback on needs and acquired skills following a short course on cross-cultural competence

Objectives The purpose of this study is to assess short and long term changes in knowledge, attitudes, and skills among medical residents following a short course on cultural competency and to explore their perspectives on the experience. Methods Eighteen medical residents went through a short training programme comprised of two seminars lasting 30' and 60' respectively over two days. Three months later, we conducted three focus groups, with 17 residents to explore their thoughts, perspectives and feedback about the course. To measure changes over time, we carried out a quantitative sequential survey before the seminars, three days after, and three months later using the Multicultural Assessment Questionnaire. Results Residents expressed a wide variety of perspectives on the main themes related to the content of the training - culture, trialogue, stereotypes, status, epidemiology, history and geopolitics - and related to its organization - relevance, volume, timing, target audience, training tools, and working material. Using the MAQ, we observed a higher global performance score (n=16) at three days (median=38) compared to results before the training (median=33) revealing a median difference of 5.5 points (z=2.4, p=0.015). This difference was still present at three months (∆=4.5, z=2.4, p=0.018), mainly due to knowledge acquisition (∆=3) rather than attitudes (∆=0) or skills (∆=1). Conclusions Cross-cultural competence training not only brings awareness of multicultural issues but also helps participants understand their own cultures, perception of others and preconceived ideas. Physicians' education should however also focus on improving implementation of acquired knowledge in cross-cultural competence.

Sustained impact of a short small group course with systematic feedback in addition to regular clinical clerkship activities on musculoskeletal examination skills-a controlled study.

BACKGROUND The discrepancy between the extensive impact of musculoskeletal complaints and the common deficiencies in musculoskeletal examination skills lead to increased emphasis on structured teaching and assessment. However, studies of single interventions are scarce and little is known about the time-dependent effect of assisted learning in addition to a standard curriculum. We therefore evaluated the immediate and long-term impact of a small group course on musculoskeletal examination skills. METHODS All 48 Year 4 medical students of a 6 year curriculum, attending their 8 week clerkship of internal medicine at one University department in Berne, participated in this controlled study. Twenty-seven students were assigned to the intervention of a 6×1 h practical course (4-7 students, interactive hands-on examination of real patients; systematic, detailed feedback to each student by teacher, peers and patients). Twenty-one students took part in the regular clerkship activities only and served as controls. In all students clinical skills (CS, 9 items) were assessed in an Objective Structured Clinical Examination (OSCE) station, including specific musculoskeletal examination skills (MSES, 7 items) and interpersonal skills (IPS, 2 items). Two raters assessed the skills on a 4-point Likert scale at the beginning (T0), the end (T1) and 4-12 months after (T2) the clerkship. Statistical analyses included Friedman test, Wilcoxon rank sum test and Mann-Whitney U test. RESULTS At T0 there were no significant differences between the intervention and control group. At T1 and T2 the control group showed no significant changes of CS, MSES and IPS compared to T0. In contrast, the intervention group significantly improved CS, MSES and IPS at T1 (p < 0.001). This enhancement was sustained for CS and MSES (p < 0.05), but not for IPS at T2. CONCLUSIONS Year 4 medical students were incapable of improving their musculoskeletal examination skills during regular clinical clerkship activities. However, an additional small group, interactive clinical skills course with feedback from various sources, improved these essential examination skills immediately after the teaching and several months later. We conclude that supplementary specific teaching activities are needed. Even a single, short-lasting targeted module can have a long lasting effect and is worth the additional effort.

Feedback-related Brain Potential Activity Complies with Basic Assumptions of Associative Learning Theory

Feedback-related negativity (FRN) is an ERP component that distinguishes positive from negative feedback. FRN has been hypothesized to be the product of an error signal that may be used to adjust future behavior. In addition, associative learning models assume that the trial-to-trial learning of cueoutcome mappings involves the minimization of an error term. This study evaluated whether FRN is a possible electrophysiological correlate of this error term in a predictive learning task where human subjects were asked to learn different cueoutcome relationships. Specifically, we evaluated the sensitivity of the FRN to the course of learning when different stimuli interact or compete to become a predictor of certain outcomes. Importantly, some of these cues were blocked by more informative or predictive cues (i.e., the blocking effect). Interestingly, the present results show that both learning and blocking affect the amplitude of the FRN component. Furthermore, independent analyses of positive and negative feedback event-related signals showed that the learning effect was restricted to the ERP component elicited by positive feedback. The blocking test showed differences in the FRN magnitude between a predictive and a blocked cue. Overall, the present results show that ERPs that are related to feedback processing correspond to the main predictions of associative learning models. ■

Promoting Programming Learning. Engagement, Automatic Assessment with Immediate Feedback in Visualizations

The skill of programming is a key asset for every computer science student. Many studies have shown that this is a hard skill to learn and the outcomes of programming courses have often been substandard. Thus, a range of methods and tools have been developed to assist students’ learning processes. One of the biggest fields in computer science education is the use of visualizations as a learning aid and many visualization based tools have been developed to aid the learning process during last few decades. Studies conducted in this thesis focus on two different visualizationbased tools TRAKLA2 and ViLLE. This thesis includes results from multiple empirical studies about what kind of effects the introduction and usage of these tools have on students’ opinions and performance, and what kind of implications there are from a teacher’s point of view. The results from studies in this thesis show that students preferred to do web-based exercises, and felt that those exercises contributed to their learning. The usage of the tool motivated students to work harder during their course, which was shown in overall course performance and drop-out statistics. We have also shown that visualization-based tools can be used to enhance the learning process, and one of the key factors is the higher and active level of engagement (see. Engagement Taxonomy by Naps et al., 2002). The automatic grading accompanied with immediate feedback helps students to overcome obstacles during the learning process, and to grasp the key element in the learning task. These kinds of tools can help us to cope with the fact that many programming courses are overcrowded with limited teaching resources. These tools allows us to tackle this problem by utilizing automatic assessment in exercises that are most suitable to be done in the web (like tracing and simulation) since its supports students’ independent learning regardless of time and place. In summary, we can use our course’s resources more efficiently to increase the quality of the learning experience of the students and the teaching experience of the teacher, and even increase performance of the students. There are also methodological results from this thesis which contribute to developing insight into the conduct of empirical evaluations of new tools or techniques. When we evaluate a new tool, especially one accompanied with visualization, we need to give a proper introduction to it and to the graphical notation used by tool. The standard procedure should also include capturing the screen with audio to confirm that the participants of the experiment are doing what they are supposed to do. By taken such measures in the study of the learning impact of visualization support for learning, we can avoid drawing false conclusion from our experiments. As computer science educators, we face two important challenges. Firstly, we need to start to deliver the message in our own institution and all over the world about the new – scientifically proven – innovations in teaching like TRAKLA2 and ViLLE. Secondly, we have the relevant experience of conducting teaching related experiment, and thus we can support our colleagues to learn essential know-how of the research based improvement of their teaching. This change can transform academic teaching into publications and by utilizing this approach we can significantly increase the adoption of the new tools and techniques, and overall increase the knowledge of best-practices. In future, we need to combine our forces and tackle these universal and common problems together by creating multi-national and multiinstitutional research projects. We need to create a community and a platform in which we can share these best practices and at the same time conduct multi-national research projects easily.

Developing an introductory object-oriented programming course

The state of the object-oriented programming course in Lappeenranta University of Technology had reached the point, where it required changes to provide better learning opportunities and thus the learning outcomes. Based on the student feedback the course was partially dated and ineffective. The components of the course were analysed and the ineffective elements were removed and new methods were introduced to improve the course. The major changes included the change from traditional teaching methods to reverse classroom method and the use of Java as the programming language. The changes were measured by the student feedback, lecturer’s observations and comparison to previous years. The feedback suggested that the changes were successful; the course received higher overall grade than before.

Utilising student profiles in mathematics course arrangements

This thesis develops a method for identifying students struggling in their mathematical studies at an early stage. It helps in directing support to students needing and benefiting from it the most. Thus, frustration felt by weaker students may decrease and therefore, hopefully, also drop outs of potential engineering students. The research concentrates on a combination of personality and intelligence aspects. Personality aspects gave information on conation and motivation for learning. This part was studied from the perspective of motivation and self-regulation. Intelligence aspects gave information on declarative and procedural knowledge: what had been taught and what was actually mastered. Students answered surveys on motivation and self-regulation in 2010 and 2011. Based on their answers, background information, results in the proficiency test, and grades in the first mathematics course, profiles describing the students were formed. In the following years, the profiles were updated with new information obtained each year. The profiles used to identify struggling students combine personality (motivation, selfregulation, and self-efficacy) and intelligence (declarative and procedural knowledge) aspects at the beginning of their studies. Identifying students in need of extra support is a good start, but methods for providing support must be found. This thesis also studies how this support could be taken into account in course arrangements. The methods used include, for example, languaging and scaffolding, and continuous feedback. The analysis revealed that allocating resources based on the predicted progress does not increase costs or lower the results of better students. Instead, it will help weaker students obtain passing grades.

Perceptions of creativity in a fashion design course /

Creativity is important to the growth and development of society, to educational institutions, and to the personal growth of individuals. Students who are aware of their creativity are assumed to have innovative ideas and fresh insights. Limited research has been conducted to see if students can identify their own creative abilities. In this study, I explored the students' perceptions and experiences in a fashion design course. This study documented the creative journey from the concept stage of an apparel collection to the final product. Participants were asked to reflect and document their creative moments, describe a creative process, and identify a creative environment. The participants were students who were enrolled in a fashion design course and were asked to participate in this study because they experienced all stages of the design process. Data were collected through personal reflection surveys, focus groups, and personal interviews. Themes of creative moments that emerged from this study were experiences that the participants had as they proceeded through the stages of the fashion design process. All of the participants identified a creative process, but the stages varied for each participant The participants identified themes related to promoting creativity in an environment, including the atmosphere, creative people, teachers, reflection, student needs, and assignments. The participants identified potential barriers in an environment, including rules and guidelines, teachers, the classroom, deadlines and time, feedback, and other important issues. The results ofthis study suggest that there needs to be a better understanding of creativity and greater support and encouragement for creativity in the classroom. Instructors need to support environments that are conducive to creative development and lead to effective learning for students. Students need to learn how to enhance their creativity as well as understand the barriers that block their creative development.

Using problem-based learning in a chemistry practical class for pharmacy students and engaging them with feedback

Objective: To introduce a new approach to problem based learning (PBL) used in the context of medicinal chemistry practical class teaching pharmacy students. Design: The described chemistry practical is based on independent studies by small groups of undergraduate students (4-5), who design their own practical work taking relevant professional standards into account. Students are carefully guided by feedback and acquire a set of skills important to their future profession as healthcare professionals. This model has been tailored to the application of PBL in a chemistry practical class setting for a large student cohort (150 students). Assessment: The achievement of learning outcomes is based on the submission of relevant documentation including a certificate of analysis, in addition to peer assessment. Some of the learning outcomes are also assessed in the final written examination at the end of the academic year. Conclusion: The described design of a novel PBL chemistry laboratory course for pharmacy students has been found to be successful. Self-reflective learning and engagement with feedback were encouraged, and students enjoyed the challenging learning experience. Skills that are highly essential for the students’ future careers as healthcare professionals are promoted.

WalkNRide: contextualising feedback in physical activity trackers

Increasing levels of sedentarism and obesity, along with advances in sensor technologies have instigated a market for wearable activity trackers, electronic devices that sense users’ physical activity levels with the goals of self-monitoring and behaviour change. Nowadays, activity trackers are one of the most desirable technologies, making up for a market of over $230 million in 2013. However, despite the spike of users’ interest, activity trackers have been shown to lose their appeal over time, with a recent survey suggesting that one out of three users discard the tracker in the course of the first six months of use. The question we pose is: how can we design activity tracker so that users’ interests is sustained over the long term? Our design approach focuses on contextualising physical activity. We do this through sensing users’ locations and activities (such as being still, walking or commuting through a car, bus or other means) and thus providing innovative ways of presenting feedback on users. This thesis presents the design and evaluation of WalkNRide, a physical activity tracker for Google Android. Through a longitudinal field study of WalkNRide, we attempt to inquire into the factors that drive the adoption (or non-adoption) of the tool as well as the ways in which the use of the tool contributes towards habit formation.

A Simple Visual Demonstration of Phase Diagram Concepts for an Introductory Materials Science Course Using Colored Solvents

A simple and effective demonstration to help students comprehend phase diagrams and understand phase equilibria and transformations is created using common chemical solvents available in the laboratory. Common misconceptions surrounding phase diagram operations, such as components versus phases, reversibility of phase transformations, and the lever rule are addressed. Three different binary liquid mixtures of varying compatibility create contrastive phase equilibrium cases, where colorful dyes selectively dissolved in each of corresponding phases allow for quick and unambiguous perceptions of solubility limit and phase transformations. Direct feedback and test scores from a group of students show evidence of the effectiveness of the visual and active teaching tool.

Quality assurance of simulated patient feedback in communication training for fourth-year medical students

Introduction In our program, simulated patients (SPs) give feedback to medical students in the course of communication skills training. To ensure effective training, quality control of the SPs’ feedback should be implemented. At other institutions, medical students evaluate the SPs’ feedback for quality control (Bouter et al., 2012). Thinking about implementing quality control for SPs’ feedback in our program, we wondered whether the evaluation by students would result in the same scores as evaluation by experts. Methods Consultations simulated by 4th-year medical students with SPs were video taped including the SP’s feedback to the students (n=85). At the end of the training sessions students rated the SPs’ performance using a rating instrument called Bernese Assessment for Role-play and Feedback (BARF) containing 11 items concerning feedback quality. Additionally the videos were evaluated by 3 trained experts using the BARF. Results The experts showed a high interrater agreement when rating identical feedbacks (ICCunjust=0.953). Comparing the rating of students and experts, high agreement was found with regard to the following items: 1. The SP invited the student to reflect on the consultation first, Amin (= minimal agreement) 97% 2. The SP asked the student what he/she liked about the consultation, Amin = 88%. 3. The SP started with positive feedback, Amin = 91%. 4. The SP was comparing the student with other students, Amin = 92%. In contrast the following items showed differences between the rating of experts and students: 1. The SP used precise situations for feedback, Amax (=maximal agreement) 55%, Students rated 67 of SPs’ feedbacks to be perfect with regard to this item (highest rating on a 5 point Likert scale), while only 29 feedbacks were rated this way by the experts. 2. The SP gave precise suggestions for improvement, Amax 75%, 62 of SPs’ feedbacks obtained the highest rating from students, while only 44 of SPs’ feedbacks achieved the highest rating in the view of the experts. 3. The SP speaks about his/her role in the third person, Amax 60%. Students rated 77 feedbacks with the highest score, while experts judged only 43 feedbacks this way. Conclusion Although evaluation by the students was in agreement with that of experts concerning some items, students rated the SPs’ feedback more often with the optimal score than experts did. Moreover it seems difficult for students to notice when SPs talk about the role in the first instead of the third person. Since precision and talking about the role in the third person are important quality criteria of feedback, this result should be taken into account when thinking about students’ evaluation of SPs’ feedback for quality control. Bouter, S., E. van Weel-Baumgarten, and S. Bolhuis. 2012. Construction and Validation of the Nijmegen Evaluation of the Simulated Patient (NESP): Assessing Simulated Patients’ Ability to Role-Play and Provide Feedback to Students. Academic Medicine: Journal of the Association of American Medical Colleges

Motivating Young Students to Start a Career in Nuclear: The Basic Course of Science and Nuclear Technology, An Educational Activity of Spanish Young Generation in Nuclear (JÓVENES NUCLEARES)

The main objective of this course, conducted by Jóvenes Nucleares (Spanish Young Generation in Nuclear, JJNN), a non-profit organization that depends on the Spanish Nuclear Society (SNE) is to pass on basic knowledge about Science and Nuclear Technology to the general public, mostly students and introduce them to its most relevant points. The purposes of this course are to provide general information, to answer the most common questions about Nuclear Energy and to motivate the young students to start a career in nuclear. Therefore, it is directed mainly to high school and university students, but also to general people that wants to learn about the key issues of such an important matter in our society. Anybody could attend the course, as no specific scientific education is required. The course is done at least once a year, during the Annual Meeting of the Spanish Nuclear Society, which takes place in a different Spanish city each time. The course is done also to whichever university or institution that asks for it to JJNN, with the only limit of the presenter´s availability. The course is divided into the following chapters: Physical nuclear and radiation principles, Nuclear power plants, Nuclear safety, Nuclear fuel, Radioactive waste, Decommission of nuclear facilities, Future nuclear power plants, Other uses of nuclear technology, Nuclear energy, climate change and sustainable development. The course is divided into 15 minutes lessons on the above topics, imparted by young professionals, experts in the field that belongs either to the Spanish Young Generation in Nuclear, either to companies and institutions related with nuclear energy. At the end of the course, a 200 pages book with the contents of the course is handed to every member of the audience. This book is also distributed in other course editions at high schools and universities in order to promote the scientific dissemination of the Nuclear Technology. As an extra motivation, JJNN delivers a course certificate to the assistants. At the end of the last edition course, in Santiago de Compostela, the assistants were asked to provide a feedback about it. Some really interesting lessons were learned, that will be very useful to improve next editions of the course. As a general conclusion of the courses it can be said that many of the students that have assisted to the course have increased their motivation in the nuclear field, and hopefully it will help the young talents to choose the nuclear field to develop their careers