Programming exercises evaluation systems: an interoperability survey

Learning computer programming requires solving programming exercises. In computer programming courses teachers need to assess and give feedback to a large number of exercises. These tasks are time consuming and error-prone since there are many aspects relating to good programming that should be considered. In this context automatic assessment tools can play an important role helping teachers in grading tasks as well to assist students with automatic feedback. In spite of its usefulness, these tools lack integration mechanisms with other eLearning systems such as Learning Management Systems, Learning Objects Repositories or Integrated Development Environments. In this paper we provide a survey on programming evaluation systems. The survey gathers information on interoperability features of these systems, categorizing and comparing them regarding content and communication standardization. This work may prove useful to instructors and computer science educators when they have to choose an assessment system to be integrated in their e-Learning environment.

The effectiveness of a teacher’s training workshop on Media Smart Program

A Work Project, presented as part of the requirements for the Award of a Masters Degree in Management from the NOVA – School of Business and Economics

The impact of urban noise on primary schools: perceptive evaluation and objective assessment

This paper aims to assess the impact of environmental noise in the vicinity of primary schools and to analyze its influence in the workplace and in student performance through perceptions and objective evaluation. The subjective evaluation consisted of the application of questionnaires to students and teachers, and the objective assessment consisted of measuring in situ noise levels. The survey covered nine classes located in three primary schools. Statistical Package for Social Sciences was used for data processing and to draw conclusions. Additionally, the relationship of the difference between environmental and background noise levels of each classroom and students with difficulties in hearing the teacherâ s voice was examined. Noise levels in front of the school, the schoolyard, and the most noise-exposed classrooms (occupied and unoccupied) were measured. Indoor noise levels were much higher than World Health Organization (WHO) recommended values: LAeq,30min averaged 70.5 dB(A) in occupied classrooms, and 38.6 dB(A) in unoccupied ones. Measurements of indoor and outdoor noise suggest that noise from the outside (road, schoolyard) affects the background noise level in classrooms but in varying degrees. It was concluded that the façades most exposed to road traffic noise are subjected to values higher than 55.0 dB(A), and noise levels inside the classrooms are mainly due to the schoolyard, students, and the road traffic. The difference between background (LA95,30min) and the equivalent noise levels (LAeq,30min) in occupied classrooms was 19.2 dB(A), which shows that studentsâ activities are a significant source of classroom noise.

Behaviour evaluation for risk-taking adolescents (BERTA): an easy to use and assess instrument to detect adolescent risky behaviours in a clinical setting.

To create an instrument to be used in an outpatient clinic to detect adolescents prone to risk-taking behaviours. Based on previous research, five identified variables (relationship with parents and teachers, liking going to school, average grades, and level of religiosity) were used to create a screening tool to detect at least one of ten risky behaviours (tobacco, alcohol, cannabis and other illegal drugs use; sexual intercourse and sexual risky behaviour; driving while intoxicated, riding with an intoxicated driver, not always using a seat belt, and not always using a helmet). The instrument was tested using the Barcelona Adolescent Health Survey 1993. A Receiver Operating Characteristics curve was used to find the best cut-off point between high and low risk score. Odds ratios and 95% confidence intervals were calculated to detect at least one risky behaviour and for each individual behaviour. In order to assess its predictive value, the analysis was repeated using the Barcelona Adolescent Health Survey 1999. In both cases, analyses were conducted for the whole sample and for younger and older adolescents. Adolescents with a high-risk score were more likely to take at least one risky behaviour both when the whole sample was analysed and by age groups. With very few exceptions, the Behaviour Evaluation for Risk-Taking Adolescents showed significant odds ratios for each individual variable. CONCLUSION: The Behaviour Evaluation for Risk-Taking Adolescents has shown its potential as an easy to use instrument to screen for risk-taking behaviours. Future research must aim towards assessing this instrument's predictive value in the clinical setting and it's application to other populations.

A multicase study for the evaluation of a pattern-based visual design process for collaborative learning

Collage is a pattern-based visual design authoring tool for the creation of collaborative learning scripts computationally modelled with IMS Learning Design (LD). The pattern-based visual approach aims to provide teachers with design ideas that are based on broadly accepted practices. Besides, it seeks hiding the LD notation so that teachers can easily create their own designs. The use of visual representations supports both the understanding of the design ideas and the usability of the authoring tool. This paper presents a multicase study comprising three different cases that evaluate the approach from different perspectives. The first case includes workshops where teachers use Collage. A second case implies the design of a scenario proposed by a third-party using related approaches. The third case analyzes a situation where students follow a design created with Collage. The cross-case analysis provides a global understanding of the possibilities and limitations of the pattern-based visual design approach.

Clinical Learning Environment and Supervision. Development and Validation of the CLES Evaluation Scale

The purpose of the study is: (1) to describe how nursing students' experienced their clinical learning environment and the supervision given by staff nurses working in hospital settings; and (2) to develop and test an evaluation scale of Clinical Learning Environment and Supervision (CLES). The study has been carried out in different phases. The pilot study (n=163) explored the association between the characteristics of a ward and its evaluation as a learning environment by students. The second version of research instrument (which was developed by the results of this pilot study) were tested by an expert panel (n=9 nurse teachers) and test-retest group formed by student nurses (n=38). After this evaluative phase, the CLES was formed as the basic research instrument for this study and it was tested with the Finnish main sample (n=416). In this phase, a concurrent validity instrument (Dunn & Burnett 1995) was used to confirm the validation process of CLES. The international comparative study was made by comparing the Finnish main sample with a British sample (n=142). The international comparative study was necessary for two reasons. In the instrument developing process, there is a need to test the new instrument in some other nursing culture. Other reason for comparative international study is the reflecting the impact of open employment markets in the European Union (EU) on the need to evaluate and to integrate EU health care educational systems. The results showed that the individualised supervision system is the most used supervision model and the supervisory relationship with personal mentor is the most meaningful single element of supervision evaluated by nursing students. The ward atmosphere and the management style of ward manager are the most important environmental factors of the clinical ward. The study integrates two theoretical elements - learning environment and supervision - in developing a preliminary theoretical model. The comparative international study showed that, Finnish students were more satisfied and evaluated their clinical placements and supervision with higher scores than students in the United Kingdom (UK). The difference between groups was statistical highly significant (p= 0.000). In the UK, clinical placements were longer but students met their nurse teachers less frequently than students in Finland. Arrangements for supervision were similar. This research process has produced the evaluation scale (CLES), which can be used in research and quality assessments of clinical learning environment and supervision in Finland and in the UK. CLES consists of 27 items and it is sub-divided into five sub-dimensions. Cronbach's alpha coefficient varied from high 0.94 to marginal 0.73. CLES is a compact evaluation scale and user-friendliness makes it suitable for continuing evaluation.

The use of textbooks in Capeverdean secondary schools: The Relationship between Use, Evaluation and Adaptation of Textbooks

This study examines the relationship between teacher’s use of English textbooks and the way teachers evaluate and adapt them, looking at a particular context, the Capeverdean secondary schools, specifically in Praia. The referred relationship was analyzed through teachers’ responses about how they use, evaluate and adapt their textbooks. The results of the study revealed that, on the one hand, the way teachers use their textbooks influences the way they evaluate the same textbooks; on the other hand, the use of textbooks doesn’t necessarily influence the way teachers adapt them. Moreover, the findings revealed that, in general, due to some particular constraints the Capeverdean English teachers are using their textbooks as resources, in which several textbooks are used in combination with one another. Additionally, although teachers assume that they are doing their best, they still need more confidence concerning the way they use, evaluate and adapt available textbooks. Teachers’ confidence in the way they are using their textbooks can be reinforced by establishing an intensive teacher training module on materials evaluation and adaptation, taking into account that a textbook is one of the most important tools in the process of teaching and learning. I hope that the elements presented may lead to further studies on this matter, specifically regarding textbook evaluation and adaptation.

Correlating trainees' translating performance with the quality of their metacognitive self-evaluation

This paper presents a study of correlations between the performance of trainee translators, according to their teacher’s assessment, and the quality of their self-evaluation, according to their answers to metacognitive questionnaires. Two case-studies of two consecutive editions of a course in general translation from German into Spanish are dealt with. The course involved the use of post-translation metacognitive questionnaires designed to help trainees to evaluate their translating. A selection of the questionnaires (from the strongest and the weakest performances by students for each course edition) is considered. The study focuses on one item in these questionnaires that has to do with identifying translation problems and justifying their solutions. An interpretive analysis of the trainees’ answers for this questionnaire item reveals that the best-performing students were more strategically and translationally aware in self-evaluating their own translating. Our conclusions are based on considering six parameters from the analysis of the trainees’ answers, which are tentatively regarded as indicative of the quality of their self-evaluation.

Evaluation of Teacher Education Programs by Students and Graduates

The purpose of this research was to do a repeated cross-sectional research on class teachers who study in the 4th year and also graduated at the Faculty of Education, University of Turku between the years of 2000 through 2004. Specifically, seven research questions were addressed to target the main purpose of the study: How do class teacher education masters’ degree senior students and graduates rate “importance; effectiveness; and quality” of training they have received at the Faculty of Education? Are there significant differences between overall ratings of importance; effectiveness and quality of training by year of graduation, sex, and age (for graduates) and sex and age (for senior students)? Is there significant relationship between respondents’ overall ratings of importance; effectiveness and their overall ratings of the quality of training and preparation they have received? Are there significant differences between graduates and senior students about importance, effectiveness, and quality of teacher education programs? And what do teachers’ [Graduates] believe about how increasing work experience has changed their opinions of their preservice training? Moreover the following concepts related to the instructional activities were studied: critical thinking skills, communication skills, attention to ethics, curriculum and instruction (planning), role of teacher and teaching knowledge, assessment skills, attention to continuous professional development, subject matters knowledge, knowledge of learning environment, and using educational technology. Researcher also tried to find influence of some moderator variables e.g. year of graduation, sex, and age on the dependent and independent variables. This study consisted of two questionnaires (a structured likert-scale and an open ended questionnaire). The population in study 1 was all senior students and 2000-2004 class teacher education masters’ degree from the departments of Teacher Education Faculty of Education at University of Turku. Of the 1020 students and graduates the researcher was able to find current addresses of 675 of the subjects and of the 675 graduates contacted, 439 or 66.2 percent responded to the survey. The population in study 2 was all class teachers who graduated from Turku University and now work in the few basic schools (59 Schools) in South- West Finland. 257 teachers answered to the open ended web-based questions. SPSS was used to produce standard deviations; Analysis of Variance; Pearson Product Moment Correlation (r); T-test; ANOVA, Bonferroni post-hoc test; and Polynomial Contrast tests meant to analyze linear trend. An alpha level of .05 was used to determine statistical significance. The results of the study showed that: A majority of the respondents (graduates and students) rated the overall importance, effectiveness and quality of the teacher education programs as important, effective and good. Generally speaking there were only a few significant differences between the cohorts and groups related to the background variables (gender, age). The different cohorts were rating the quality of the programs very similarly but some differences between the cohorts were found in the importance and effectiveness ratings. Graduates of 2001 and 2002 rated the importance of the program significantly higher than 2000 graduates. The effectiveness of the programs was rated significantly higher by 2001 and 2003 graduates than other groups. In spite of these individual differences between cohorts there were no linear trends among the year cohorts in any measure. In respondents’ ratings of the effectiveness of teacher education programs there was significant difference between males and females; females rated it higher than males. There were no significant differences between males’ and females’ ratings of the importance and quality of programs. In the ratings there was only one difference between age groups. Older graduates (35 years or older) rated the importance of the teacher training significantly higher that 25-35 years old graduates. In graduates’ ratings there were positive but relatively low correlations between all variables related to importance, effectiveness and quality of Teacher Education Programs. Generally speaking students’ ratings about importance, effectiveness and quality of teacher education program were very positive. There was only one significant difference related to the background variables. Females rated higher the effectiveness of the program. The comparison of students’ and graduates’ perception about importance, effectiveness, and quality of teacher education programs showed that there were no significant differences between graduates and students in the overall ratings. However there were differences in some individual variables. Students rated higher in importance of “Continuous Professional Development”, effectiveness of “Critical Thinking Skills” and “Using Educational Technology” and quality of “Advice received from the advisor”. Graduates rated higher in importance of “Knowledge of Learning Environment” and effectiveness of “Continuous Professional Development”. According to the qualitative data of study 2 some graduates expressed that their perceptions have not changed about the importance, effectiveness, and quality of training that they received during their study time. They pointed out that teacher education programs have provided them the basic theoretical/formal knowledge and some training of practical routines. However, a majority of the teachers seems to have somewhat critical opinions about the teacher education. These teachers were not satisfied with teacher education programs because they argued that the programs failed to meet their practical demands in different everyday situations of the classroom e.g. in coping with students’ learning difficulties, multiprofessional communication with parents and other professional groups (psychologists and social workers), and classroom management problems. Participants also emphasized more practice oriented knowledge of subject matter, evaluation methods and teachers’ rights and responsibilities. Therefore, they (54.1% of participants) suggested that teacher education departments should provide more practice-based courses and programs as well as closer collaboration between regular schools and teacher education departments in order to fill gap between theory and practice.

INTERACTIONS: DESIGN, IMPLEMENTATION AND EVALUATION OF A COMPUTATIONAL TOOL FOR TEACHING INTERMOLECULAR FORCES IN HIGHER EDUCATION

Intermolecular forces are a useful concept that can explain the attraction between particulate matter as well as numerous phenomena in our lives such as viscosity, solubility, drug interactions, and dyeing of fibers. However, studies show that students have difficulty understanding this important concept, which has led us to develop a free educational software in English and Portuguese. The software can be used interactively by teachers and students, thus facilitating better understanding. Professors and students, both graduate and undergraduate, were questioned about the software quality and its intuitiveness of use, facility of navigation, and pedagogical application using a Likert scale. The results led to the conclusion that the developed computer application can be characterized as an auxiliary tool to assist teachers in their lectures and students in their learning process of intermolecular forces.

Schools as Oral Health Promoters – Evaluation of National Sweet Selling Recommendation and Oral Health Education Material

The aims were to find out 1) if schools’ oral health practices were associated with pupils’ oral health behaviour and whether 2) the national sweet-selling recommendation and 3) distributing oral health material (OHEM) affected schools as oral health promoters. Three independently collected datasets from Finnish upper comprehensive schools (N=988) were used: longitudinal oral health practices data (n=258) with three-year follow up (2007 n=480, 2008 n=508, 2009 n=593) from principals’ online questionnaires, oral health behaviour data from pupils participating in the national School Health Promotion Study (n=970 schools) and oral health education data from health education teachers’ online questionnaires (2008 n=563, 2009 n=477 teachers). Oral health practices data and oral health behaviour data were combined (n=414) to answer aim 1. For aims 2 and 3, oral health practices data and oral health education data were used independently. School sweet selling and an open campus policy were associated with pupils’ use of sweet products and tobacco products during school time. The National Recommendation was quite an effective way to reduce the number of sweet-selling schools, but there were large regional differences and a lack of a clear oral health policy in the schools. OHEM did not increase the proportion of teachers teaching oral health, but teachers started to cover oral health topics more frequently. Women started to use OHEM more often than men did. Schools’ oral health policy should include prohibiting the selling of sweet products in school by legislative actions, enabling healthy alternatives instead, and setting a closed campus policy to protect pupils from school-time sweet consuming and smoking.

Training graduate students to be teachers

Pedagogic education of graduate students, when and where it exists, is restricted to theoretical courses or to the participation of the students as teachers' assistants. This model is essentially reproductive and offers few opportunities for any significant curriculum innovation. To open an opportunity for novelty we have introduced a new approach in "Biochemistry Teaching", a course included in the Biochemistry Graduate Program of the Biochemistry Department (Universidade Estadual de Campinas and Universidade de São Paulo). The content of the course consists of a) choosing the theme, b) selecting and organizing the topics, c) preparing written material, d) establishing the methodological strategies, e) planning the evaluation tools and, finally, f) as teachers, conducting the course as an optional summer course for undergraduate students. During the first semester the graduate students establish general and specific educational objectives, select and organize contents, decide on the instructional strategies and plan evaluation tools. The contents are explored using a wide range of strategies, which include computer-aided instruction, laboratory classes, small group teaching, a few lectures and round table discussions. The graduate students also organize printed class notes to be used by the undergraduate students. Finally, as a group, they teach the summer course. In the three versions already developed, the themes chosen were Biochemistry of Exercise (UNICAMP), Biochemistry of Nutrition (UNICAMP) and Molecular Biology of Plants (USP). In all cases the number of registrations greatly exceeded the number of places and a selection had to be made. The evaluation of the experience by both graduate and undergraduate students was very positive. Graduate students considered this experience to be unique and recommended it to their schoolmates; the undergraduate students benefited from a more flexible curriculum (more options) and gave very high scores to both the courses and the teachers.

Responding to Changing Student Demographics in Finland: A Study of Teachers’ Developing Cultural Competence

The aim of this dissertation was to examine the skills and knowledge that pre-service teachers and teachers have and need about working with multilingual and multicultural students from immigrant backgrounds. The specific goals were to identify pre-service teachers’ and practising teachers’ current knowledge and awareness of culturally and linguistically responsive teaching, identify a profile of their strengths and needs, and devise appropriate professional development support and ways to prepare teachers to become equitable culturally responsive practitioners. To investigate these issues, the dissertation reports on six original empirical studies within two groups of teachers: international pre-service teacher education students from over 25 different countries as well as pre-service and practising Finnish teachers. The international pre-service teacher sample consisted of (n = 38, study I; and n = 45, studies II-IV) and the pre-service and practising Finnish teachers sample encompassed (n = 89, study V; and n = 380, study VI). The data used were multi-source including both qualitative (students’ written work from the course including journals, final reflections, pre- and post-definition of key terms, as well as course evaluation and focus group transcripts) and quantitative (multi-item questionnaires with open-ended options), which enhanced the credibility of the findings resulting in the triangulation of data. Cluster analytic procedures, multivariate analysis of variance (MANOVA), and qualitative analyses mostly Constant Comparative Approach were used to understand pre-service teachers’ and practising teachers’ developing cultural understandings. The results revealed that the mainly white / mainstream teacher candidates in teacher education programmes bring limited background experiences, prior socialisation, and skills about diversity. Taking a multicultural education course where identity development was a focus, positively influenced teacher candidates’ knowledge and attitudes toward diversity. The results revealed approaches and strategies that matter most in preparing teachers for culturally responsive teaching, including but not exclusively, small group activities and discussions, critical reflection, and field immersion. This suggests that there are already some tools to address the need for the support needed to teach successfully a diversity of pupils and provide in-service training for those already practising the teaching profession. The results provide insight into aspects of teachers’ knowledge about both the linguistic and cultural needs of their students, as well as what constitutes a repertoire of approaches and strategies to assure students’ academic success. Teachers’ knowledge of diversity can be categorised into sound awareness, average awareness, and low awareness. Knowledge of diversity was important in teachers’ abilities to use students’ language and culture to enhance acquisition of academic content, work effectively with multilingual learners’ parents/guardians, learn about the cultural backgrounds of multilingual learners, link multilingual learners’ prior knowledge and experience to instruction, and modify classroom instruction for multilingual learners. These findings support the development of a competency based model and can be used to frame the studies of pre-service teachers, as well as the professional development of practising teachers in increasingly diverse contexts. The present set of studies take on new significance in the current context of increasing waves of migration to Europe in general and Finland in particular. They suggest that teacher education programmes can equip teachers with the necessary attitudes, skills, and knowledge to enable them work effectively with students from different ethnic and language backgrounds as they enter the teaching profession. The findings also help to refine the tools and approaches to measuring the competencies of teachers teaching in mainstream classrooms and candidates in preparation.

The transformation of teachers: an adult learning approach

The study focused on the teacher as an adult learner rather than an instructor. A sample of three hundred and three elementary school teachers completed a two-part Likert survey questionnaire. The instrument was developed by the researcher in an attempt to operationalize Mezirow's Theory of Perspective Transformation. The four sub-scales collected information about teachers as they perceived themselves as adult learners and the way they conceptualize critical SelfReflection, Meaning perspectives and New Insights (Mezirow, 1978, 1981, 1989, 1990) within a framework of Mezirow's concept of Transformative Learning. Survey research methodology was used. Frequency distributions, means, and standard deviation were calculated. Reliability analysis and Pearson 'r' correlations established the internal consistency of items It Cross tabulations to describe differences in responses across demographic valuables were computed. The survey results indicated that teachers perceived themselves as self-directed learners. The findings support the need for a better understanding of the teacher as an adult learner so that teacher inservice programs and teacher supervision and evaluation can provide a viable learning alternative to the existing models used in practice.

Course/instructor evaluation : perspectives of part-time graduate students

This study explored 6 part-time graduate students' perspectives on course/instructor evaluation. The purpose was to explore whether a link exists between the evaluation for course and instructors as contained in the Faculty of Education courselinstructor evaluation form and the needs of part-time students enrolled in that program. The literature review provided contextual information concerning the 3 main subject areas based upon which the research questions were designed: learner needs in the context of part-time graduate students, courselinstructor eval~ation, and the potential lack of congruency between the 2. Using a semistructured interview process, participants identified criteria important or relevant to the evaluation process and incongruent with the course/instructor evaluation form. A qualitative research methodology using a grounded theory approach contributed to the theory on the nature of course evaluation instruments in a graduate program and addressed the notion of where power was situated within the evaluation process. Findings suggested that the concepts of relevance and the instructor's role that participants identified as important in their graduate learning experience were congruent with what they considered important components of the course/instructor evaluation form. Participants noted a lack of congruency between their expectations of a quality graduate learning experience and the format, content, intent, and timing of the evaluation process. The study confirmed that students did want a voice in the evaluation of their learning experience at both the course and program levels.