Promoting Programming Learning. Engagement, Automatic Assessment with Immediate Feedback in Visualizations

The skill of programming is a key asset for every computer science student. Many studies have shown that this is a hard skill to learn and the outcomes of programming courses have often been substandard. Thus, a range of methods and tools have been developed to assist students’ learning processes. One of the biggest fields in computer science education is the use of visualizations as a learning aid and many visualization based tools have been developed to aid the learning process during last few decades. Studies conducted in this thesis focus on two different visualizationbased tools TRAKLA2 and ViLLE. This thesis includes results from multiple empirical studies about what kind of effects the introduction and usage of these tools have on students’ opinions and performance, and what kind of implications there are from a teacher’s point of view. The results from studies in this thesis show that students preferred to do web-based exercises, and felt that those exercises contributed to their learning. The usage of the tool motivated students to work harder during their course, which was shown in overall course performance and drop-out statistics. We have also shown that visualization-based tools can be used to enhance the learning process, and one of the key factors is the higher and active level of engagement (see. Engagement Taxonomy by Naps et al., 2002). The automatic grading accompanied with immediate feedback helps students to overcome obstacles during the learning process, and to grasp the key element in the learning task. These kinds of tools can help us to cope with the fact that many programming courses are overcrowded with limited teaching resources. These tools allows us to tackle this problem by utilizing automatic assessment in exercises that are most suitable to be done in the web (like tracing and simulation) since its supports students’ independent learning regardless of time and place. In summary, we can use our course’s resources more efficiently to increase the quality of the learning experience of the students and the teaching experience of the teacher, and even increase performance of the students. There are also methodological results from this thesis which contribute to developing insight into the conduct of empirical evaluations of new tools or techniques. When we evaluate a new tool, especially one accompanied with visualization, we need to give a proper introduction to it and to the graphical notation used by tool. The standard procedure should also include capturing the screen with audio to confirm that the participants of the experiment are doing what they are supposed to do. By taken such measures in the study of the learning impact of visualization support for learning, we can avoid drawing false conclusion from our experiments. As computer science educators, we face two important challenges. Firstly, we need to start to deliver the message in our own institution and all over the world about the new – scientifically proven – innovations in teaching like TRAKLA2 and ViLLE. Secondly, we have the relevant experience of conducting teaching related experiment, and thus we can support our colleagues to learn essential know-how of the research based improvement of their teaching. This change can transform academic teaching into publications and by utilizing this approach we can significantly increase the adoption of the new tools and techniques, and overall increase the knowledge of best-practices. In future, we need to combine our forces and tackle these universal and common problems together by creating multi-national and multiinstitutional research projects. We need to create a community and a platform in which we can share these best practices and at the same time conduct multi-national research projects easily.

Harmonization ofsignificant environmental aspects and their risk assessment in UPM paper and pulp mills

Työn tavoite onharmonisoida yhtenäiset rakenteet UPM:n paperi- ja sellutehtaiden merkittävilleympäristönäkökohdille sekä niiden ympäristöriskienhallintajärjestelmille. Näin saavutetaan yhteneväiset tavoitteet ja analysointikeinot yrityksen yksiköille. Harmonisointiprosessi on osa koko yrityksen ympäristöhallintajärjestelmän kehittämistä. Ja konsernin EMS -prosessi puolestaan konvergoi konsernin integroidun johtamisjärjestelmän kehitystä. Lisäksi työn tapaustutkimuksessa selvitettiin riskienhallintajärjestelmien integroitumispotentiaalia. Sen avulla saavutettaisiin paremmin suuren yrityksen synergia-etuja ja vuorovaikutteisuutta toimijoiden kesken, sekä parannettaisiin riskienhallintajärjestelmän mukautuvuutta ja käytettävyyttä. Työssä käsitellään kolmea esimerkkiä, joiden pohjalta tehdään esitys harmonisoiduille merkittäville ympäristönäkökohdille sekä riskienhallintajärjestelmien parametreille. Tutkimusongelmaa lähestytään haastattelujen, kirjallisuuden, yrityksen PWC:llä teettämän selvityksen sekä omien päätelmien avulla. Lisäksi työssä esitetään ympäristöhallintajärjestelmän tehokkuuden todentaminen ympäristösuorituskyvyn muuttujiin suhteutettuna. Pohjana jatkuvan kehityksen päämäärälle on organisaatio-oppiminen, niin yksittäisen työntekijän, tiimien kuin eri yksiköiden kesken. Se antaa sysäyksen aineettoman omaisuuden, kuten ympäristö-osaamisen, hyödyntämiseen parhaalla mahdollisella tavalla. Tärkeimpinä lopputuloksina työssä ovat ehdotukset harmonisoiduille merkittäville ympäristönäkökohdille sekä ympäristöriskienhallintajärjestelmän määritetyille komponenteille. Niitä ovat määritelmät ja skaalat riskien todennäköisyydelle, seurauksille sekä riskiluokille. Työn viimeisenä osana luodaan pohja tapaustutkimuksen avulla Rauman tehtaan jätevedenpuhdistamon kahden erilaisen riskienhallintajärjestelmän integroitumiselle.

Assessment of critical competences required in managing end-user driven businesses in a global forest products compa

Työn pääasiallisena tavoitteena on selvittää ydinosaamista, jota tarvitaan kansainvälisen metsäteollisuusyrityksen loppukäyttäjävetoisessa liiketoiminnassa. Lisäksi tavoitteena on laatia kompetenssimalli, jota voidaan käyttää mm. rekrytoinnissa, koulutuksen ja työnkierron suunnittelussa. Tarkoituksena on tarkastella sekä tällä hetkellä että tulevaisuudessa tarvittavia ydinosaamisia. Työ keskittyy myyntihenkilöiden kompetenssien kuvaamiseen. Kirjallisuuden ja asiantuntijoiden haastattelujen avulla on selvitetty. kompetensseihin liittyviä asioita ja käsitteitä, kuten organisaation oppiminen, innovaatiot sekä asiakaslähtöisyys. Tämän jälkeen on kartoitettu case-yrityksen kartonkiyksikön myyntihenkilökunnan kompetensseja. Kompetenssikartoitus on tehty teemahaastattelujen avulla sekä lisäksi on käytetty työn aikana laadittua kompetenssimatriisia. Saatuja tuloksia on verrattu yhden asiakkaan näkemyksiin. Tulosten mukaan kolme tärkeintä tämän hetken kompetenssia ovat: holistinen näkemys asioista, suhteiden rakentaminen ja kielitaito. Tulevaisuuden tärkeimpiä kompetensseja puolestaan ovat: asiakaslähtöisyys, sähköinen kaupankäynti ja suhteiden rakentaminen. Lopuksi on käsitelty yleisiä metsäteollisuuden tulevaisuuden haasteita sekä annettu joitain kehitysideoita kompetenssien kehittämistä varten.

Social competence and loneliness during the school years - Issues in assessment, interrelations and intergenerational transmission

Väitöskirjassa tarkastellaan kouluikäisten lasten ja nuorten sosiaalisen kompetenssin ja yksinäisyyden mittaamista, yhteyksiä ja periytyvyyttä vanhemmilta heidän lapsilleen. Alakouluikäisten lasten tutkimusaineisto (n=985) koostuu lapsilta itseltään, heidän luokkatovereiltaan, opettajiltaan ja vanhemmiltaan vuosina 2000 - 2004 osana Merkitystä etsimässä – tutkimusprojektia (M. Vauras) kerätystä aineistosta. Mukana on itse-, toveri-, opettaja- ja vanhempien arviot lasten sosiaalisesta kompetenssista, seuranta-aineisto lasten yksinäisyydestä, opettajien arviot lasten motivationaalisesta orientaatiosta, standardoiduin testisarjoin arvioidut akateemiset taidot sekä lasten äitien ja isien arviot omasta yksinäisyydestään ja koetusta kyvykkyydestään toimia vanhempana. Yläkouluikäisten nuorten (n=386) aineisto koostuu vuosina 2006 – 2007 osana Sosioemotionaalinen oppiminen ja hyvinvointi yläkouluyhteisössä (P. M. Niemi) kerätystä nuorten yksinäisyyden, sosiaalisen ahdistuneisuuden ja sosiaalisen fobian seuranta-aineistosta. Mitattavuutta (päätavoite 1) tutkittiin erityisesti monitahoarviointien rakenteiden yhtenäisyyksiä, subjektiivisten arvioiden ajallista pysyvyyttä sekä mittareiden validiteettia ja reliabiliteettia testaamalla. Sosiaalisen kompetenssin ja yksinäisyyden keskinäisten yhteyksien lisäksi tarkasteltiin näiden yhteyttä alakoululaisten oppimiseen sekä yläkou¬lulaisten psykososiaaliseen hyvinvointiin (päätavoite 2). Kolmantena päätavoitteena oli selvittää yksinäisyyden mahdollista periytymistä vanhemmilta lapsille. Osana ensimmäistä päätavoitetta kehitettiin Monitahoarviointi sosiaalisesta kompetenssista (MASK) -arviointimenetelmä (artikkeli 1). Konfirmatorisen faktorianalyysin tulosten perusteella nelifaktorinen rakenne (prososiaalisuus sisältäen yhteistyötaidot ja empatiakyvyn sekä antisosiaalisuus sisältäen impulsiivisuuden ja häiritsevyyden) sopi sekä lasten itsensä, heidän luokkatovereidensa, opettajiensa että vanhempiensa tekemiin arviointeihin. Eri tahojen arviointien väliset korrelaatiot olivat tilastollisesti merkitseviä, joskin suhteellisen matalia, ts. eri tahojen näkökulmat lapsen sosiaalisesta kompetenssista ovat toisistaan eriäviä. Täten eri arvioitsijatahojen käyttäminen on kokonaisuuden tutkimisen kannalta tärkeää. Toisena mittaamiseen liittyvänä tavoitteena oli validoida Hozan, Bukowskin ja Beeryn (2000) sosiaalisen ja emotionaalisen yksinäisyyden mittari suomalaisille lapsille (artikkeli 3) ja nuorille (artikkeli 4) soveltuvaksi sekä tutkia, ovatko lasten ja nuorten arviot omasta yksinäisyydestään ajallisesti pysyviä. Alakoululaisten lasten osalta yksinäisyys, erityisesti sosiaalinen yksinäisyys osoittautui suhteellisen pysyväksi, mutta vahvistui entisestään yläkouluikäisten nuorten aineistoa tarkasteltaessa. Huomionarvoista sekä ala- että yläkoululaisten aineistoissa oli poikien kokema vahva emotionaalinen yksinäisyys. Molempien mittareiden osalta sekä validiteetti että reliabiliteetti todettiin hyväksyttäväksi ja niitä voidaan suositella lasten ja nuorten sosiaalisen kompetenssin ja yksinäisyyden arviointimenetelmiksi. Toisena päätavoitteena oli rakenneyhtälömallinnuksen keinoin tarkastella sosiaalisen kompetenssin ja yksinäisyyden yhteyksiä sekä keskenään (artikkelit 2 ja 3) että suhteessa lasten oppimiseen (artikkeli 2) ja nuorten psykososiaaliseen hyvinvointiin (artikkeli 4). Alakouluikäisten lasten osalta sosiaalinen kompetenssi oli yhteydessä pait¬si yksinäisyyteen myös opettajien oppilaistaan tekemiin motivationaalisen orientaation arvioihin sekä standardoiduin testien arvioituihin akateemisiin taitoihin. Yläkouluikäisten nuorten osalta yksinäisyys oli yhteydessä sosiaaliseen ahdistuneisuuteen ja sosiaaliseen fobiaan. Täten sosiaalisen kompetenssin voidaan katsoa olevan koululaisten hyvinvointia ja oppimista vahvistava, ja toisaalta yksinäisyyden nuorten psykososiaalista hyvinvointia heikentävä tekijä. Viimeisenä päätavoitteena mallinnettiin yksinäisyyden mahdollista periytyvyyttä. Ensimmäisessä vaiheessa periytyvyyttä tarkasteltiin koko perheen sisällä, vanhempien tai lasten sukupuolta erottelematta (artikkeli 2). Tässä rakenneyhtälömallissa vanhempien kokema yksinäisyys ennusti heikompaa kyvykkyydentunnetta vanhemmuudesta, joka edelleen ennusti lapsen heikompaa toveriarvioitua sosiaalista kompetenssia koulussa ja tätä kautta vahvempaa yksinäisyyden kokemusta. Toisessa mallissa eroteltiin äitien ja isien sekä tyttöjen ja poikien aineistot, jotta periytyvyyttä voitiin tarkastella äiti-tytär, äiti-poika, isä-tytär ja isä-poika dyadisuhteissa. Rakenneyhtälömallinnuksen tulosten perusteella sekä äitien että isien kokema yksinäisyys ennusti

The effectiveness of short-term literacy skills intervention on children at risk of reading and writing difficulties in Tanzania : a study of grade one children with dynamic assessment approach

The aim of the study was to create and evaluate an intervention programme for Tanzanian children from a low-income area who are at risk of reading and writing difficulties. The learning difficulties, including reading and writing difficulties, are likely to be behind many of the common school problems in Tanzania, but they are not well understood, and research is needed. The design of the study included an identification and intervention phase with follow-up. A group based dynamic assessment approach was used in identifying children at risk of difficulties in reading and writing. The same approach was used in the intervention. The study was a randomized experiment with one experimental and two control groups. For the experimental and the control groups, a total of 96 (46 girls and 50 boys) children from grade one were screened out of 301 children from two schools in a low income urban area of Dar-es-Salaam. One third of the children, the experimental group, participated in an intensive training programme in literacy skills for five weeks, six hours per week, aimed at promoting reading and writing ability, while the children in the control groups had a mathematics and art programme. Follow-up was performed five months after the intervention. The intervention programme and the tests were based on the Zambian BASAT (Basic Skill Assessment Tool, Ketonen & Mulenga, 2003), but the content was drawn from the Kiswahili school curriculum in Tanzania. The main components of the training and testing programme were the same, only differing in content. The training process was different from traditional training in Tanzanian schools in that principles of teaching and training in dynamic assessment were followed. Feedback was the cornerstone of the training and the focus was on supporting the children in exploring knowledge and strategies in performing the tasks. The experimental group improved significantly more (p = .000) than the control groups during the intervention from pre-test to follow-up (repeated measures ANOVA). No differences between the control groups were noticed. The effect was significant on all the measures: phonological awareness, reading skills, writing skills and overall literacy skills. A transfer effect on school marks in Kiswahili and English was found. Following a discussion of the results, suggestions for further research and adaptation of the programme are presented.

Self-Assessment Report for International Accreditation - Bachelor’s and Master’s degree programmes in Environmental Technology

Ympäristötekniikan kandidaatin ja diplomi-insinöörin tutkinto-ohjelmien itsearviointiraportissa käsitellään tutkinto-ohjelmien osaamistavoitteita ja niiden saavuttamista. Raportissa käydään läpi myös käytössä olevat resurssit sekä tutkinto-ohjelmiin liittyviä tunnuslukuja. Itsearviointi on toteutettu kansainvälisen akkreditointijärjestön kriteerien mukaisesti (ASIIN ja EUR-ACE).

Focusing on the quality of learning processes

S. 327-333

Self-Assessment Report for International Accreditation - Chemical Engineering

Kemiantekniikan kandidaatin ja diplomi-insinöörin tutkinto-ohjelmien itsearviointiraportissa käsitellään tutkinto-ohjelmien osaamistavoitteita ja niiden saavuttamista. Raportissa käydään läpi myös käytössä olevat resurssit sekä tutkinto-ohjelmiin liittyviä tunnuslukuja. Itsearviointi on toteutettu kansainvälisen akkreditointijärjestön kriteerien mukaisesti (ASIIN ja EUR-ACE).

Assessment of Young Learners’ English Proficiency in Bilingual Content Instruction CLIL

This applied linguistic study in the field of second language acquisition investigated the assessment practices of class teachers as well as the challenges and visions of language assessment in bilingual content instruction (CLIL) at primary level in Finnish basic education. Furthermore, pupils’ and their parents’ perceptions of language assessment and LangPerform computer simulations as an alternative, modern assessment method in CLIL contexts were examined. The study was conducted for descriptive and developmental purposes in three phases: 1) a CLIL assessment survey; 2) simulation 1; and 3) simulation 2. All phases had a varying number of participants. The population of this mixed methods study were CLIL class teachers, their pupils and the pupils’ parents. The sampling was multi-staged and based on probability and random sampling. The data were triangulated. Altogether 42 CLIL class teachers nationwide, 109 pupils from the 3rd, 4th and 5th grade as well as 99 parents from two research schools in South-Western Finland participated in the CLIL assessment survey followed by an audio-recorded theme interview of volunteers (10 teachers, 20 pupils and 7 parents). The simulation experimentations 1 and 2 produced 146 pupil and 39 parental questionnaires as well as video interviews of volunteered pupils. The data were analysed both quantitatively using percentages and numerical frequencies and qualitatively employing thematic content analysis. Based on the data, language assessment in primary CLIL is not an established practice. It largely appears to be infrequent, incidental, implicit and based on impressions rather than evidence or the curriculum. The most used assessment methods were teacher observation, bilingual tests and dialogic interaction, and the least used were portfolios, simulations and peer assessment. Although language assessment was generally perceived as important by teachers, a fifth of them did not gather assessment information systematically, and 38% scarcely gave linguistic feedback to pupils. Both pupils and parents wished to receive more information on CLIL language issues; 91% of pupils claimed to receive feedback rarely or occasionally, and 63% of them wished to get more information on their linguistic coping in CLIL subjects. Of the parents, 76% wished to receive more information on the English proficiency of their children and their linguistic development. This may be a response to indirect feedback practices identified in this study. There are several challenges related to assessment; the most notable is the lack of a CLIL curriculum, language objectives and common ground principles of assessment. Three diverse approaches to language in CLIL that appear to affect teachers’ views on language assessment were identified: instrumental (language as a tool), dual (language as a tool and object of learning) and eclectic (miscellaneous views, e.g. affective factors prioritised). LangPerform computer simulations seem to be perceived as an appropriate alternative assessment method in CLIL. It is strongly recommended that the fundamentals for assessment (curricula and language objectives) and a mutual assessment scheme should be determined and stakeholders’ knowledge base of CLIL strengthened. The principles of adequate assessment in primary CLIL are identified as well as several appropriate assessment methods suggested.

A multimethod examination of contributors to successful on-the-job learning for vocational students

Rapid changes in working life and competence requirements of different professions have increased interest in workplace learning. It is considered an effective way to learn and update professional skills by performing daily tasks in an authentic environment. Especially, ensuring a supply of skilled future workers is a crucial issue for firms facing tight competition and a shortage of competent employees due to the retirement of current professionals. In order to develop and make the most of workplace learning, it is important to focus on workplace learning environments and the individual characteristics of those participating in workplace learning. The literature has suggested various factors that influence adults' and professionals’ workplace learning of profession-related skills, but lacks empirical studies on contextual and individual-related factors that positively affect students' workplace learning. Workers with vocational education form a large group in modern firms. Therefore, elements of vocational students’ successful workplace learning during their studies, before starting their career paths, need to be examined. To fill this gap in the literature, this dissertation examines contributors to vocational students’ workplace learning in Finland, where students’ workplace learning is included in the vocational education and training system. The study is divided into two parts: the introduction, comprised of the overview of the relevant literature and the conclusion of the entire study, and five separate articles. Three of the articles utilize quantitative methods and two use qualitative methods to examine factors that contribute to vocational students’ workplace learning. The results show that, from the students’ perspective, attitudinal, motivational, and organizationrelated factors enhance the student’s development of professionalism during the on-the-job learning period. Specifically, the organization-related factors such as innovative climate, guidance, and interactions with seniors have a strong positive impact on the students’ perceived development of professional skills because, for example, the seniors’ guidance and provision of new viewpoints for the tasks helps the vocational students to gain autonomy at work performance. A multilevel analysis shows that of those factors enhancing workplace learning from the student perspective, innovative climate, knowledge transfer accuracy, and the students’ performance orientation were significantly related to the workplace instructors’ assessment regarding the students’ professional performance. Furthermore, support from senior colleagues and the students’ self-efficacy were both significantly associated with the formal grades measuring how well the students managed to learn necessary professional skills. In addition, the results suggest that the students’ on-the-job learning can be divided into three main phases, of which two require efforts from both the student and the on-the-job learning organization. The first phase includes the student’s application of basic professional skills, demonstration of potential in performing daily tasks, and orientation provided by the organization at the beginning of the on-the-job learning period. In the second phase, the student actively develops profession-related skills by performing daily tasks, thus learning a fluent working style while observing the seniors’ performance. The organization offers relevant tasks and follows the student’s development. The third level indicates a student who has reached the professional level described as a full occupation. The results suggest that constructing the vocational students’ successful on-the-job learning period requires feedback from seniors, opportunities to learn to manage entire work processes, self-efficacy on the part of the students, proactive behavior, and initiative in learning. The study contributes to research on workplace learning in three ways: firstly, it identifies the key individual- and organization-based factors that influence the vocational students’ successful on-the-job learning from their perspective and examines mutual relationships between these factors. Second, the study provides knowledge of how the factors related to the students’ view of successful workplace learning are associated with the workplace instructors’ perspective and the formal grades. Third, the present study finds elements needed to construct a successful on-the-job learning for the students.

Designing new learning experiences? : exploring corporate E-learners’ self-regulated learning

The context of this study is corporate e-learning, with an explicit focus on how digital learning design can facilitate self-regulated learning (SRL). The field of e-learning is growing rapidly. An increasing number of corporations use digital technology and elearning for training their work force and customers. E-learning may offer economic benefits, as well as opportunities for interaction and communication that traditional teaching cannot provide. However, the evolving variety of digital learning contexts makes new demands on learners, requiring them to develop strategies to adapt and cope with novel learning tools. This study derives from the need to learn more about learning experiences in digital contexts in order to be able to design these properly for learning. The research question targets how the design of an e-learning course influences participants’ self-regulated learning actions and intentions. SRL involves learners’ ability to exercise agency in their learning. Micro-level SRL processes were targeted by exploring behaviour, cognition, and affect/motivation in relation to the design of the digital context. Two iterations of an e-learning course were tested on two groups of participants (N=17). However, the exploration of SRL extends beyond the educational design research perspective of comparing the effects of the changes to the course designs. The study was conducted in a laboratory with each participant individually. Multiple types of data were collected. However, the results presented in this thesis are based on screen observations (including eye tracking) and video-stimulated recall interviews. These data were integrated in order to achieve a broad perspective on SRL. The most essential change evident in the second course iteration was the addition of feedback during practice and the final test. Without feedback on actions there was an observable difference between those who were instruction-directed and those who were self-directed in manipulating the context and, thus, persisted whenever faced with problems. In the second course iteration, including the feedback, this kind of difference was not found. Feedback provided the tipping point for participants to regulate their learning by identifying their knowledge gaps and to explore the learning context in a targeted manner. Furthermore, the course content was consistently seen from a pragmatic perspective, which influenced the participants’ choice of actions, showing that real life relevance is an important need of corporate learners. This also relates to assessment and the consideration of its purpose in relation to participants’ work situation. The rigidity of the multiple choice questions, focusing on the memorisation of details, influenced the participants to adapt to an approach for surface learning. It also caused frustration in cases where the participants’ epistemic beliefs were incompatible with this kind of assessment style. Triggers of positive and negative emotions could be categorized into four levels: personal factors, instructional design of content, interface design of context, and technical solution. In summary, the key design choices for creating a positive learning experience involve feedback, flexibility, functionality, fun, and freedom. The design of the context impacts regulation of behaviour, cognition, as well as affect and motivation. The learners’ awareness of these areas of regulation in relation to learning in a specific context is their ability for design-based epistemic metareflection. I describe this metareflection as knowing how to manipulate the context behaviourally for maximum learning, being metacognitively aware of one’s learning process, and being aware of how emotions can be regulated to maintain volitional control of the learning situation. Attention needs to be paid to how the design of a digital learning context supports learners’ metareflective development as digital learners. Every digital context has its own affordances and constraints, which influence the possibilities for micro-level SRL processes. Empowering learners in developing their ability for design-based epistemic metareflection is, therefore, essential for building their digital literacy in relation to these affordances and constraints. It was evident that the implementation of e-learning in the workplace is not unproblematic and needs new ways of thinking about learning and how we create learning spaces. Digital contexts bring a new culture of learning that demands attitude change in how we value knowledge, measure it, define who owns it, and who creates it. Based on the results, I argue that digital solutions for corporate learning ought to be built as an integrated system that facilitates socio-cultural connectivism within the corporation. The focus needs to shift from designing static e-learning material to managing networks of social meaning negotiation as part of a holistic corporate learning ecology.