Alternative Assessment in Engineering Language Education: The case of the Technical University of Madrid

This article describes a research project involving students from nine different engineering degrees at the Technical university of Madrid. The purpose of the project was to analyze the use of peer and self assessment and the students? attitudes toward alternative assessment procedures.

Assessment of Young Learners’ English Proficiency in Bilingual Content Instruction CLIL

This applied linguistic study in the field of second language acquisition investigated the assessment practices of class teachers as well as the challenges and visions of language assessment in bilingual content instruction (CLIL) at primary level in Finnish basic education. Furthermore, pupils’ and their parents’ perceptions of language assessment and LangPerform computer simulations as an alternative, modern assessment method in CLIL contexts were examined. The study was conducted for descriptive and developmental purposes in three phases: 1) a CLIL assessment survey; 2) simulation 1; and 3) simulation 2. All phases had a varying number of participants. The population of this mixed methods study were CLIL class teachers, their pupils and the pupils’ parents. The sampling was multi-staged and based on probability and random sampling. The data were triangulated. Altogether 42 CLIL class teachers nationwide, 109 pupils from the 3rd, 4th and 5th grade as well as 99 parents from two research schools in South-Western Finland participated in the CLIL assessment survey followed by an audio-recorded theme interview of volunteers (10 teachers, 20 pupils and 7 parents). The simulation experimentations 1 and 2 produced 146 pupil and 39 parental questionnaires as well as video interviews of volunteered pupils. The data were analysed both quantitatively using percentages and numerical frequencies and qualitatively employing thematic content analysis. Based on the data, language assessment in primary CLIL is not an established practice. It largely appears to be infrequent, incidental, implicit and based on impressions rather than evidence or the curriculum. The most used assessment methods were teacher observation, bilingual tests and dialogic interaction, and the least used were portfolios, simulations and peer assessment. Although language assessment was generally perceived as important by teachers, a fifth of them did not gather assessment information systematically, and 38% scarcely gave linguistic feedback to pupils. Both pupils and parents wished to receive more information on CLIL language issues; 91% of pupils claimed to receive feedback rarely or occasionally, and 63% of them wished to get more information on their linguistic coping in CLIL subjects. Of the parents, 76% wished to receive more information on the English proficiency of their children and their linguistic development. This may be a response to indirect feedback practices identified in this study. There are several challenges related to assessment; the most notable is the lack of a CLIL curriculum, language objectives and common ground principles of assessment. Three diverse approaches to language in CLIL that appear to affect teachers’ views on language assessment were identified: instrumental (language as a tool), dual (language as a tool and object of learning) and eclectic (miscellaneous views, e.g. affective factors prioritised). LangPerform computer simulations seem to be perceived as an appropriate alternative assessment method in CLIL. It is strongly recommended that the fundamentals for assessment (curricula and language objectives) and a mutual assessment scheme should be determined and stakeholders’ knowledge base of CLIL strengthened. The principles of adequate assessment in primary CLIL are identified as well as several appropriate assessment methods suggested.

The integration of curriculum and assessment in interpreter education

In dieser interdisziplinären, translationswissenschaftlichen Studie wird die Integration von Curriculum und Evaluierung in der Dolmetscherausbildung theoretisch fundiert und im Rahmen einer Fallstudie empirisch untersucht. Dolmetschkompetenz wird als ein durch zweckgerechte und messgenaue (valid and reliable) Bewertungsmethoden dokumentiertes Ergebnis der Curriculumanwendung betrachtet. Definitionen, Grundlagen, Ansätze, Ausbildungs- und Lernziele werden anhand der Curriculumtheorie und Dolmetschwissenschaft beschrieben. Traditionelle und alternative Evaluierungsmethoden werden hinsichtlich ihrer Anwendbarkeit in der Dolmetscherausbildung erprobt. In der Fallstudie werden die Prüfungsergebnisse zweier Master-Studiengänge-MA Konferenzdolmetschen und MA Dolmetschen und Übersetzen-quantitativ analysiert. Die zur Dokumentation der Prüfungsergebnisse eingesetzte Bewertungsmethodik wird qualitativ untersucht und zur quantitativen Analyse in Bezug gesetzt. Die Fallstudie besteht aus 1) einer chi-square-Analyse der Abschlussprüfungsnoten getrennt nach Sprachkombination und Prüfungskategorie (n=260), 2) einer Umfrage unter den Jurymitgliedern hinsichtlich der Evaluierungsansätze, -verfahren, und -kriterien (n = 45; 62.22% Rücklaufrate); und 3) einer Analyse des ausgangssprachlichen Prüfungsmaterials ebenfalls nach Sprachkombination und Prüfungskategorie. Es wird nachgewiesen, dass Studierende im MA Dolmetschen und Übersetzen tendenziell schlechtere Prüfungsleistungen erbringen als Studierende im MA Konferenzdolmetschen. Die Analyseergebnisse werden jedoch als aussageschwach betrachtet aufgrund mangelnder Evaluierungsvalidität. Schritte zur Curriculum- und Evaluierungsoptimierung sowie ein effizienteres Curriculummodell werden aus den theoretischen Ansätzen abgeleitet. Auf die Rolle der Ethik in der Evaluierungsmethodik wird hingewiesen.

Experiences in the assessment of the requirement management process

The focus of this paper is to outline the practical experiences and the lessons learned derived from the assessment of the requirements management process in two industrial case studies. Furthermore this paper explains the main structure of an alternative assessment approach that has been used in the appraisal of the two case studies. The assessment approach helped us to know the current state of the organizational requirement management process. We have to point out that these practical experiences and the lessons learned can be helpful to reduce risks and costs of the on-site assessment process.

O e-portefólio como instrumento de avaliação de desempenho e veículo de partilha entre os professores do ensino básico

O tema da avaliação de desempenho dos professores continua a ser um tema muito presente no dia-a-dia de uma escola. O atual modelo de avaliação veio revolucionar o meio e acabou por trazer com ele o descontentamento dos professores. Face a este descontentamento, procurámos, investigar a exequibilidade de um novo instrumento de avaliação: o e-portefólio. Assim, o foco deste estudo de caso centra-se em estudar a praticabilidade da utilização de um instrumento de avaliação alternativo, o e-portfólio, enquanto instrumento de partilha entre os docentes e possível instrumento de avaliação de desempenho. Para o efeito desenvolvemos um estudo de natureza qualitativa, tendo realizado entrevistas semiestruturadas a um conjunto de professores do ensino básico, e posteriormente procedido à sua análise de conteúdo. Da análise e interpretação dos resultados concluímos que os docentes consideram que a partilha de materiais, através de e-portefólios, veio facilitar a vida dos professores e que estes assumem-se como um auxílio precioso e vantajoso no dia-a-dia dos docentes. Concluímos, também, que o e-portefólio poderá ser um possível instrumento de avaliação a adotar, desde que rigorosa e criteriosamente utilizado, uma vez que poderá estar bem visível parte do trabalho que os professores realizam. Os dados alertam, ainda, para a necessidade de uma reflexão, por parte da tutela, para a constante falta de tempo e excesso de burocracias mencionadas pelos professores.

A numeric model to simulate solar individual ultraviolet exposure.

Exposure to solar ultraviolet (UV) light is the main causative factor for skin cancer. UV exposure depends on environmental and individual factors. Individual exposure data remain scarce and development of alternative assessment methods is greatly needed. We developed a model simulating human exposure to solar UV. The model predicts the dose and distribution of UV exposure received on the basis of ground irradiation and morphological data. Standard 3D computer graphics techniques were adapted to develop a rendering engine that estimates the solar exposure of a virtual manikin depicted as a triangle mesh surface. The amount of solar energy received by each triangle was calculated, taking into account reflected, direct and diffuse radiation, and shading from other body parts. Dosimetric measurements (n = 54) were conducted in field conditions using a foam manikin as surrogate for an exposed individual. Dosimetric results were compared to the model predictions. The model predicted exposure to solar UV adequately. The symmetric mean absolute percentage error was 13%. Half of the predictions were within 17% range of the measurements. This model provides a tool to assess outdoor occupational and recreational UV exposures, without necessitating time-consuming individual dosimetry, with numerous potential uses in skin cancer prevention and research.

Radiographic adenoid evaluation: proposal of an objective parameter

Objective The objective of the present study was to evaluate current radiographic parameters designed to investigate adenoid hypertrophy and nasopharyngeal obstruction, and to present an alternative radiographic assessment method. Materials and Methods In order to do so, children (4 to14 years old) who presented with nasal obstruction or oral breathing complaints were submitted to cavum radiographic examination. One hundred and twenty records were evaluated according to quantitative radiographic parameters, and data were correlated with a gold-standard videonasopharyngoscopic study, in relation to the percentage of choanal obstruction. Subsequently, a regression analysis was performed in order to create an original model so the percentage of the choanal obstruction could be predicted. Results The quantitative parameters demonstrated moderate, if not weak correlation with the real percentage of choanal obstruction. The regression model (110.119*A/N) demonstrated a satisfactory ability to “predict” the actual percentage of choanal obstruction. Conclusion Since current adenoid quantitative radiographic parameters present limitations, the model presented by the present study might be considered as an alternative assessment method in cases where videonasopharyngoscopic evaluation is unavailable.

Emptying the bell jar: an exploration of adolescent responses to a women's literature unit /

This study examines adolescent student responses to a women's literature unit taught within a grade 12 Writer's Craft course. Current research (Gilligan, 1989, Pipher, 1994 & Slack, 1999) suggests that there is a great under-representation of female authors in the high school literature curriculum. The use of women's literature may draw attention to important literary figures who are historically overlooked within the curriculum. It gives voice to a marginalized group and presents students with alternative subjects and heroes. It encourages students to develop a critical perspective and reevaluate assumptions about institutions, ideologies, language and culture. It also allows me, as a teacher, to reflect on my own teaching practices and explore alternate feminist pedagogical principles and teaching styles encouraging multiplicity of voices, deconstruction of power relations, and alternative assessment tools within the classroom. As an educator, it is important for me to teach curriculum that is relevant and meaningful to students and help them become critical, self-reflective thinkers. It is also important for me to assist students in their exploration of self and encourage them to expand their awareness of historical, social and global issues. Sylvia Plath's (1963) The belljar is used as the primary text taught within this unit. In this novel, the bell jar is a central image that signifies entrapment and isolation. "To the person in the bell jar, blank and stopped as a dead body, the world itself is the bad dream"(p.l 54). As a metaphor, the bell jar resonates with young readers in a variety of ways.

Auto-avaliação: uma alternativa contemporânea do processo avaliativo

A auto-avaliação, segundo as pesquisas, tem se mostrado um excelente auxiliar para o processo de ensino/aprendizagem em sala de aula, como mecanismo diagnóstico, para que professores e alunos tenham uma visão mais clara de suas potencialidades. Este artigo, portanto, tem como objetivo apresentar as diferentes alternativas de auto-avaliação, seus objetivos e suas restrições, além de estudos bem-sucedidos em que foram utilizados esse instrumento avaliativo, à luz de teorias nas áreas de Educação e Lingüística Aplicada.

La evaluación del Trabajo Fin de Grado a través de la rúbrica

[ES] En el área de Ciencias Sociales en la actualidad, dada la situación novedosa y compleja de la evaluación de la asignatura Trabajo Fin de Grado (TFG), se precisa de nuevos modelos que orienten a los diferentes agentes que tendrán que desarrollar la evaluación: tutores, miembros del tribunal, etc. El objetivo en este artículo es presentar una propuesta de evaluación alternativa que oriente a los tutores en la valoración de las competencias transversales de los TFG de las titulaciones de Educación Infantil y Primaria a través de la rúbrica. Presentamos el proceso de diseño que hemos seguido en dos rúbricas para establecer su calidad. Las orientaciones que ofrecemos han surgido de una revisión de la literatura existente y de un trabajo de campo. [EN] The Final Year Project, a new compulsory subject linked to Social Sciences, has been recently introduced in the Spanish University Degrees. Given its novelty and the difficulties its assessment entails, those agents, involved in evaluating the students’ perform ance on this subject (e.g. supervisors, members of the assessment committee), need a fresh set of guidelines to assist their work. In order to meet this need in the Degrees of Preschool and Primary Education, our objective in this paper is to propose an alternative assessment model to help supervisors judge the TFGs by means of a rubric, and we offer two examples of this instrument. These assessment tools have been adapted for the TFGs where students specifically carry out a bibliographic review. The guidelines that we suggest here are the result of both the revision of existing research and fieldwork.

El aula de múscia: múltiples realidades superpuestas

[ES] En el área de Ciencias Sociales en la actualidad, dada la situación novedosa y compleja de la evaluación de la asignatura Trabajo Fin de Grado (TFG), se precisa de nuevos modelos que orienten a los diferentes agentes que tendrán que desarrollar la evaluación: tutores, miembros del tribunal, etc. El objetivo en este artículo es presentar una propuesta de evaluación alternativa que oriente a los tutores en la valoración de las competencias transversales de los TFG de las titulaciones de Educación Infantil y Primaria a través de la rúbrica. Presentamos el proceso de diseño que hemos seguido en dos rúbricas para establecer su calidad. Las orientaciones que ofrecemos han surgido de una revisión de la literatura existente y de un trabajo de campo. [EN] The Final Year Project, a new compulsory subject linked to Social Sciences, has been recently introduced in the Spanish University Degrees. Given its novelty and the difficulties its assessment entails, those agents, involved in evaluating the students’ performa ce on this subject (e.g. supervisors, members of the assessment committee), need a fresh set of guidelines to assist their work. In order to meet this need in the Degrees of Preschool and Primary Education, our objective in this paper is to propose an alternative assessment model to help supervisors judge the TFGs by means of a rubric, and we offer two examples of this instrument. These assessment tools have been adapted for the TFGs where students specifically carry out a bibliographic review. The guidelines that we suggest here are the result of both the revision of existing research and fieldwork.

Designing multiple user perspectives and functionality for clinical decision support systems

Clinical Decision Support Systems (CDSSs) need to disseminate expertise in formats that suit different end users and with functionality tuned to the context of assessment. This paper reports research into a method for designing and implementing knowledge structures that facilitate the required flexibility. A psychological model of expertise is represented using a series of formally specified and linked XML trees that capture increasing elements of the model, starting with hierarchical structuring, incorporating reasoning with uncertainty, and ending with delivering the final CDSS. The method was applied to the Galatean Risk and Safety Tool, GRiST, which is a web-based clinical decision support system (www.egrist.org) for assessing mental-health risks. Results of its clinical implementation demonstrate that the method can produce a system that is able to deliver expertise targetted and formatted for specific patient groups, different clinical disciplines, and alternative assessment settings. The approach may be useful for developing other real-world systems using human expertise and is currently being applied to a logistics domain. © 2013 Polish Information Processing Society.

Caminhos para a avaliação da formação em odontologia: desenvolvimento, validação e aplicação de critérios

The need for universal access to health and the failure of the pedagogical model centered on the transmission of knowledge has led to changes in the training of health professionals. The objective of this study was to provide a new alternative for evaluating dental students through the development, validation and application of evaluation criteria based on the National Curriculum Guidelines (DCN in Brazil). Therefore, the study was conducted in three phases: development and validation of evaluation criteria of Dentistry courses based on the DCN; a pilot study to verify the applicability of the validated criteria and evaluation of the dentistry courses in the Northeast. In the first stage, a logical model was formulated, allowing for the construction of a criteria matrix, validated by a modified Delphi consensus technique. The validated matrix has the following dimensions: Profile of graduates, health care guidance, teaching and service integration, and pedagogical approach. The pilot study was conducted in five dental courses through a documentary study of the pedagogical project course (PPC), and application of validated questionnaires and interviews with course coordinators. The results of the pilot study indicate the possibility of being verified by means of validated criteria and using different methodological proposals, advances and curricular limitations facing the proposed reorientation of training recommended by DCN. The evaluation of Northeast Dentistry courses was carried out by applying a questionnaire validating a matrix of 30 course coordinators, including public and private institutions. The data were submitted to descriptive analysis, and also tested the difference between means and the correlation between the assessment of the coordinators in the dimensions and sub-dimensions with each other, among the general evaluation of courses and between the following variables: administrative category, time since last curriculum updating, participation in reorienting the training of health professionals programs, ENADE and CPC (Preliminary Concepts of the Course) scores in the year 2013. Positive correlation (p <0.01) was found between the means obtained by the perception of the coordinators in most dimensions, and also between them and the overall performance of the course. There were no significant differences between the coordinators’ perception about course performance and the administrative category (public / private). This difference is slightly higher when the average performance is compared with respect to time due to the last curriculum update, getting better performance in courses with the latest updated curriculum, even with there not 11 being this significant difference between dimensions. Better averages of performance were obtained in courses that do not participate in reorientation programs of professional training, with a significant difference (p<0.05) for the overall score and for all dimensions except the dimensions of teaching-service Integration (p = 0.064). There was no significant correlation between the assessment of coordinators in all dimensions, in the overall assessment or ENADE and CPC scores in 2013. The final instrument proposed in this study is a different alternative assessment for health training of both dentists and other professionals, considering that the DCN providing for the training and graduation of professionals is focused on the health needs of the population, integrated with the SUS (the National Brazilian Health System) and based on student-centered learning.

Problem solving competency and the mathematical kangaroo

The goal of the study was to investigate differences in how two groups of students activated mathematical competencies in the mathematical kangaroo (MK). The two groups, group 1 and 2, were identified from a sample of 264 students (grade 7, age 13) through high achievement (top 20 %) in only one of the tests: the MK or a curriculum bounded test (CT). Analysis of mathematical competencies showed that the high achievers in the MK, activated the problem solving competency to a greater extent than the high achievers in the CT, when doing the MK. The results indicate the importance of using non-traditional tests in the assessment process of students to be able to find students that might possess good mathematical competencies although they do not show it on curriculum bounded tests.

Hip fracture prognosis: could bioimpedance be an alternative to conventional nutritional assessment?

Background: Risk-factors for mortality in hip fractures encompass nutritional status, nominally body mass index, but not body composition. Given the difficulty of anthropometric assessment in bedridden patients a prospective study with bioimpedance analysis was designed. Methods: Elderly patients with hip fracture were consecutively recruited. Biochemical tests, primitive bioimpedance measurements (resistance, reactance and phase angle) and follow-up till one year were targeted. Results: Patients (N = 69, 81.2 +/- 8.1 years old, 72.5% females) stayed in the hospital for 15.5 +/- 17.1 days, and 18.8 %(13/69) required further hospitalization during the ensuing months. Mortality was 11.6% within 30 days, coinciding with hospital mortality, and an additional 11.6% till one year, thus reaching 23.2%. Anemia, hypoalbuminemia and low transferrin, along with elevated glucose and urea were frequent, suggesting undernutrition with metabolic derangements. Reactance, urea and creatinine were different in patients suffering both early and late demise. Resistance, white blood cell count and osteoporosis were risk factors for early mortality only, and anemia exclusively for late mortality. Conclusions: Primitive bioimpedance measurements, which had not been hitherto investigated, were prognostically related to early and late mortality. These markers of disease-related malnutrition and especially reactance should be further studied in patients unfit for anthropometric evaluation due to fracture and immobility.